-- Logs begin at Wed 2022-08-24 07:18:01 UTC, end at Wed 2022-08-24 08:21:08 UTC. -- Aug 24 07:43:38.802921 dv-cinder-852210-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 07:43:38.812739 dv-cinder-852210-4-smb devstack@keystone.service[81518]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:43:38 2022] *** Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: nodename: dv-cinder-852210-4-smb Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: machine: x86_64 Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: clock source: unix Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: pcre jit disabled Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: detected number of CPU cores: 4 Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: current working directory: / Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: your processes number limit is 47680 Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: your memory page size is 4096 bytes Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: detected max file descriptor number: 2048 Aug 24 07:43:38.813288 dv-cinder-852210-4-smb devstack@keystone.service[81518]: lock engine: pthread robust mutexes Aug 24 07:43:38.813958 dv-cinder-852210-4-smb devstack@keystone.service[81518]: thunder lock: enabled Aug 24 07:43:38.813958 dv-cinder-852210-4-smb devstack@keystone.service[81518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 07:43:38.813958 dv-cinder-852210-4-smb devstack@keystone.service[81518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:43:38.853905 dv-cinder-852210-4-smb devstack@keystone.service[81518]: Python main interpreter initialized at 0x556d3844b9c0 Aug 24 07:43:38.853905 dv-cinder-852210-4-smb devstack@keystone.service[81518]: python threads support enabled Aug 24 07:43:38.853905 dv-cinder-852210-4-smb devstack@keystone.service[81518]: your server socket listen backlog is limited to 100 connections Aug 24 07:43:38.853905 dv-cinder-852210-4-smb devstack@keystone.service[81518]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:43:38.854317 dv-cinder-852210-4-smb devstack@keystone.service[81518]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:43:38.854317 dv-cinder-852210-4-smb devstack@keystone.service[81518]: *** Operational MODE: preforking *** Aug 24 07:43:38.854613 dv-cinder-852210-4-smb devstack@keystone.service[81518]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:43:38.854613 dv-cinder-852210-4-smb devstack@keystone.service[81518]: spawned uWSGI master process (pid: 81518) Aug 24 07:43:38.854815 dv-cinder-852210-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 07:43:38.857298 dv-cinder-852210-4-smb devstack@keystone.service[81518]: spawned uWSGI worker 1 (pid: 81532, cores: 1) Aug 24 07:43:38.857298 dv-cinder-852210-4-smb devstack@keystone.service[81518]: spawned uWSGI worker 2 (pid: 81533, cores: 1) Aug 24 07:43:38.857298 dv-cinder-852210-4-smb devstack@keystone.service[81518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:43:43.104072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:43.104072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: from cryptography.utils import int_from_bytes Aug 24 07:43:43.104875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:43.104875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: from cryptography.utils import int_from_bytes Aug 24 07:43:43.105328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:43.105328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: from cryptography.utils import int_from_bytes Aug 24 07:43:43.105446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:43:43.105446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: from cryptography.utils import int_from_bytes Aug 24 07:43:43.155381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:43:43.155605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:43:43.155803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] command line args: [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:43:43.156070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:43:43.156253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ================================================================================ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:43:43.156512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] admin_token = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.156763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] config_dir = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.156956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.157143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] config_source = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.157351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] debug = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.157557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.158050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.158146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.158347 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.158598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.158832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.159015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_config_append = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.159195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.159404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_dir = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.159549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.159787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.160036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.160284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.160534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.160716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.160896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.161142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.161425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.161664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.161854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:43:43.161944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.162067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:43:43.162150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.162222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] command line args: [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:43:43.162340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.162493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:43:43.162617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.162699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ================================================================================ {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:43:43.162820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.162903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] admin_token = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] config_dir = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] config_source = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] debug = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] publish_errors = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.163870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.164059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.164732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.164846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.164932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_config_append = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] standard_threads = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.165920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_dir = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_file = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] use_journal = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] use_json = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] use_stderr = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.166979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.167081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] use_syslog = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.167218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.167305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.167398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.167560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.167639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.167799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.167885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.168039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.168133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.168276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.168361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.168508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.168591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.168740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.168822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.168971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.169057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.169215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.169323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.169481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.169560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.169735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.169862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.169987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.170223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.170300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.170402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] publish_errors = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.170491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.170632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.170715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.170861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.170944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.171034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.171161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.171270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.171400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.171501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.171654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.171741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] standard_threads = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.171906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.171983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.172152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.172237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.172337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.172424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.172497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] use_journal = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.172632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.172710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] use_json = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.172835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] use_stderr = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.172917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.172996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] use_syslog = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.173133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.173210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:43:43.173431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.173511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.173667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.173757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.173900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.173983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.174946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.175896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.176998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.177954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.178992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.179946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.180869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.181987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.182996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.183960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.184946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.185070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.185167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.185450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.185585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.185749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.185906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.186975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.187144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.187276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.187442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.187607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.187736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.187897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.188965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.189953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.190963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.191965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.external = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.192984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.password = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.token = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.193965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.194920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.195871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.196861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.197892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.external = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.198908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.password = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] auth.token = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.199845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.200953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.201958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.202989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.203962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.204935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.205920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.206900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.207993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208557 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.208947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.209930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.210716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.211377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.211473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.211644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.211736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.211892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.211972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.212883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.213905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.214993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.215947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.216983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.217947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.218913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.219849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.220942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.221954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.222914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.223973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.224950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.225922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.226080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.226168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.226315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.226394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] role.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] role.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.229971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.230996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.231963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] role.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] role.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.232988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.233998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.234947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.235978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.236854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.237865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.238953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.239933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.240945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.241923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.242894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.243987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.244066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.244160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:43:43.244241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.244445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.244687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.244982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.245247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.connection = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.245509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.245755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.245991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.246230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.246465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.246699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.246934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.247169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.247410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.247644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.247884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.248117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.248362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.248598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.248838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.249067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.249328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.249562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:43:43.249730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:43:43.274557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.274787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.274898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.275014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.275104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.275319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.283454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.283807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.311855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.312088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.312787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.313021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.365986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.366121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.415705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.415946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.416125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.416367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.573608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.573794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.573897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.573981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.574786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.597758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.597995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.598936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.599015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.599151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.599243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.599365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.599582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.610934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.611164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.624156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.624644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.624644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.624787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.624957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.625176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.625418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.625644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.625876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.626096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.626314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.628065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.628065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.628065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81532) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:43:43.642350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.642565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:43:43.642914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.643121 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:43:43.643206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.643335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:43:43.643429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.643656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.643740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.643872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:43:43.643965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.644154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.644420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.644750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.644935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.645479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.654521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.654806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.655085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.655375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.655459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.655669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.655949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.656241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.662305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.663212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.665203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.665518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.665807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.666096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.666179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.666392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.666489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.666661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.666746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.666936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.667883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.668041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.668159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.668428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.668711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.668989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.690479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.691377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.691933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.692225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.692864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.693154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.697401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.697692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.697980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.698311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.698600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.698889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.704261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.704556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.705178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.705495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.708619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.708917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.709205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.709536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.709620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.709822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.709908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.710104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.710189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.710379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.710473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.710655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.710740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.711539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.711820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.712099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.728073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.728367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.728983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.729290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.732227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.733196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.735444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.735749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.736420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.736724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.739956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.740928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.743667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.744596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.746950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.747261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.747554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.747846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.747930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.748131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.748225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.748437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.748522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.748796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.749096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.749424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.764679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.764983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.765280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.765557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.765748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.766054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.766331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.766609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.772642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.774192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.774291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.774476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.775712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.776001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.777110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.777424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.777728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.778025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.778310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.778679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.778970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.779266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.779563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.779844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.789739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.790030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.790320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.790609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.790896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.791164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.791298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.791450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.791544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.791736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.792024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.792310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.792593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.792877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.807339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.808637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.810369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.811710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.813230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.814586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.814670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.816018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.816140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.816437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.816736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.817515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.817806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.818104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.823253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.824714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.825097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.826586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.827618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.827921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.828215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.828504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.829489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.829787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.830077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.830369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.836951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.837248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.837560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.838790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.839095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.839393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.844400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.844690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.844978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.845275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.845559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.845838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.846128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.846272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81532) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:43:43.846411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.846562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.846692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.846847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.846978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.847978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.848083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.848248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.848529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.848809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.849088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.849399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.849680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.849945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81532) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:43:43.882432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d3844b9c0 pid: 81533 (default app) Aug 24 07:43:43.884637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d3844b9c0 pid: 81532 (default app) Aug 24 07:43:43.885791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb912b1f-3dd7-4442-930c-fb047a24fc23 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.886081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb912b1f-3dd7-4442-930c-fb047a24fc23 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.886356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb912b1f-3dd7-4442-930c-fb047a24fc23 None None] PATH_INFO: `/v3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.890530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Aug 24 07:43:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:50.373772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.374238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.374323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.378642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:50.385036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.385424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.385628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.455807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: INFO dbcounter [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] Registered counter for database keystone Aug 24 07:43:50.474527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG oslo_db.sqlalchemy.engines [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:50.481159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writer thread running {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:50.660496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG passlib.handlers.bcrypt [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81533) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:43:50.660847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG passlib.handlers.bcrypt [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81533) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:43:50.714873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:50.716454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:50.842401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 07:43:51.286232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:51.354241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: INFO dbcounter [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] Registered counter for database keystone Aug 24 07:43:51.376057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG oslo_db.sqlalchemy.engines [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:51.382189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writer thread running {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:51.500357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe210f4e-1a41-4986-9e8e-862b7cc445c5 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.504675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.505309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.505596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.505874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.513877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.565802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:43:51.566100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29c8f9-205b-46d3-ba86-97a24bb7b6e1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.575660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 24 07:43:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:43:51.581704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:51.596422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27ed8-4262-4cf5-9786-43381f1ba694 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.600872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.602621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.602908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.603182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] PATH_INFO: `/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.604750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5d9282c24b4d00b4d4a768619e22cb)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.658147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING keystone.common.rbac_enforcer.enforcer [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:43:51.658491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198344a4-12c2-41be-be1f-9ad1a7274f29 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.662984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Aug 24 07:43:51 2022] GET /identity/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:53.515990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7a40-b6ee-43a9-9fb8-cd76851c46da None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.516594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7a40-b6ee-43a9-9fb8-cd76851c46da None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.516594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7a40-b6ee-43a9-9fb8-cd76851c46da None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.520973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:53.526798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.527188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.527348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.547253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:53.548761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:53.556455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 07:43:53.822539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7a40-b6ee-43a9-9fb8-cd76851c46da None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.834553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7a40-b6ee-43a9-9fb8-cd76851c46da None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.839387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046366b-cde8-4893-9a7e-fc4f5e0feee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.839990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046366b-cde8-4893-9a7e-fc4f5e0feee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.840270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046366b-cde8-4893-9a7e-fc4f5e0feee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.840543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046366b-cde8-4893-9a7e-fc4f5e0feee0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.848069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046366b-cde8-4893-9a7e-fc4f5e0feee0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.849885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046366b-cde8-4893-9a7e-fc4f5e0feee0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.858456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:43:53.863539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.872602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc5db-c076-448f-b0ed-b2e4938f5e44 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.876870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8906ae-f357-4ebc-9991-565d0476fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.877520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8906ae-f357-4ebc-9991-565d0476fffd admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.877798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8906ae-f357-4ebc-9991-565d0476fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.878083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8906ae-f357-4ebc-9991-565d0476fffd admin admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.879364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8906ae-f357-4ebc-9991-565d0476fffd admin admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.881149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8906ae-f357-4ebc-9991-565d0476fffd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.882675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:55.810954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af867-2a65-4b25-ac26-8157582976bc None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.811488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af867-2a65-4b25-ac26-8157582976bc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.811488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af867-2a65-4b25-ac26-8157582976bc None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.812830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:55.818140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.818561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.818686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.837400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:55.838566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:55.879085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844c18e-79c4-4503-bad5-c6ae1144b0eb None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.879449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844c18e-79c4-4503-bad5-c6ae1144b0eb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.879734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844c18e-79c4-4503-bad5-c6ae1144b0eb None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.881046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:55.886751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.887034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.887307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.918046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:55.928335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG passlib.handlers.bcrypt [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81532) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:43:55.928770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG passlib.handlers.bcrypt [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81532) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:43:55.975061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:55.976618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:56.072531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:56.182366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.206076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.285206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e1520-dd47-4103-832f-e4db8dff6eb1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.318450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.319082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.319364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.319638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.330722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:56.339429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:56.340348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:43:56.345745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:56.346888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.346968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.434033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.451361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e351b-d00e-4543-8e44-f3a9dae2eca0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.452868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712323d-dfd8-4eb6-a61b-fbb8f94c3950 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.453649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.487388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.487993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.488273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.488382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.488544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.489150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.489254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:56.489461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.489549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.489735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.490876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.502805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:56.508210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.557140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.558671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.606981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267e3fe-8a33-454f-b9e3-e1d534230a02 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.640249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.640862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.641141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.641442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.642555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.643980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.646030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:56.651264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.665387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.665922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:56.671375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.674132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.752205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ecbe3-1917-44a6-a866-731992f9fb96 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.771233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10e32-245d-479c-b886-643bc0007052 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.785701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.786328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.786613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.786885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.787996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.789470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.791008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:56.797093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.808783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.809671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.809967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.810229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.828802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.830296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:43:56.848954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:56.850030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:43:56.850972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:43:56.850972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:43:56.850972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:43:56.850972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:56.857612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.879486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.899096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094f50-fd88-4fdf-babf-d28dbc7c5c5a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.914004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.932791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.933434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.933717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.933995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.934713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.domain.id=default, user.id=9c73d388b9994677b676c66beb55374b) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:56.935027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.936453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8977d-0191-4258-9537-749b93bd236d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.943100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/role_assignments?user.id=9c73d388b9994677b676c66beb55374b&scope.domain.id=default&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:56.957365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eeba3-8226-4ecd-b3fa-b5f1d843e803 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.994934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.995566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.995845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.996118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.996773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:56.997077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.998509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182ddd1-2bf6-4ea5-a39a-6f3301943131 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:57.017403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:59.103780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84840339-d7fc-4e7d-a511-127ea7025752 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.104309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84840339-d7fc-4e7d-a511-127ea7025752 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.104309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84840339-d7fc-4e7d-a511-127ea7025752 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.105841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:59.111125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1129b-0459-4c40-94ef-98d085ee5317 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.111924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1129b-0459-4c40-94ef-98d085ee5317 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.112447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1129b-0459-4c40-94ef-98d085ee5317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.124662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f16f0-bf05-4c61-890c-f73090a6a7d3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.124971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f16f0-bf05-4c61-890c-f73090a6a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.125225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f16f0-bf05-4c61-890c-f73090a6a7d3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.127022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:59.137285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76716b-ce66-48c6-92f7-077eda215912 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.137285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76716b-ce66-48c6-92f7-077eda215912 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.137285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76716b-ce66-48c6-92f7-077eda215912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.143233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-21d1129b-0459-4c40-94ef-98d085ee5317 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:59.144771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-21d1129b-0459-4c40-94ef-98d085ee5317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:59.153931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5f76716b-ce66-48c6-92f7-077eda215912 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:59.155142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5f76716b-ce66-48c6-92f7-077eda215912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:59.228616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 14/24] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:59.263930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 11/25] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:59.583084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939db8d2-f7cf-43a4-9dce-1068b46b519c None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.583781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939db8d2-f7cf-43a4-9dce-1068b46b519c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.584275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939db8d2-f7cf-43a4-9dce-1068b46b519c None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.586281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:59.592781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d9203-aa19-4f98-9ca1-762fd579b990 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.593343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d9203-aa19-4f98-9ca1-762fd579b990 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.593840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d9203-aa19-4f98-9ca1-762fd579b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.617417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b02d9203-aa19-4f98-9ca1-762fd579b990 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:59.619540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b02d9203-aa19-4f98-9ca1-762fd579b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:59.656372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939db8d2-f7cf-43a4-9dce-1068b46b519c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.704365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.736024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 12/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:59.737593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e81-97be-4ee3-9ec2-625acd9b8b1c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.737988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e81-97be-4ee3-9ec2-625acd9b8b1c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.738384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e81-97be-4ee3-9ec2-625acd9b8b1c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.740076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 13/28] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:59.741272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432e81-97be-4ee3-9ec2-625acd9b8b1c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.762611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.793977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939db8d2-f7cf-43a4-9dce-1068b46b519c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.831206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e217f05-9cd0-4066-ad17-a2d13c38ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.831998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e217f05-9cd0-4066-ad17-a2d13c38ed0b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.832361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e217f05-9cd0-4066-ad17-a2d13c38ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.832715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e217f05-9cd0-4066-ad17-a2d13c38ed0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.844643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e217f05-9cd0-4066-ad17-a2d13c38ed0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1e217f05-9cd0-4066-ad17-a2d13c38ed0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:59.849542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:59.850556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:59.851506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:43:59.852322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 16/29] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:59.853590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.853800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.854087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.873066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:59.874350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:59.947319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 17/30] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:59.948143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.006221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432e81-97be-4ee3-9ec2-625acd9b8b1c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.053655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.078553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.079210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.079488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.079765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.103832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.105244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.120814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0011b5d-e9aa-45d6-b9cc-5315d6478fbb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:00.136516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:00.137741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:00.138647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:00.138647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:00.138647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:00.138647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 14/31] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:00.146190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.166591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.167215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.167499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.167778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.168447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:00.168752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.170488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.180690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.190631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.196051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.312478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570ab0-82ff-456e-bbb4-df5881ecd8af None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.319696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf55b-532a-45d3-94ec-22878c317af3 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.351340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.361165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.361758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.362042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.362318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.363536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.365062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.365287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.366108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.366564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.366798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 19/33] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:00.367226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.367617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.368297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:00.369356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.371126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.388546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 15/34] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.393280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.494412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.507699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ddf46-cd7e-412d-85ec-3025eb2f1905 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.518585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f540b-5185-42aa-893d-9df973004d63 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.544552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.545537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.546029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.546559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.547418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.549102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.564909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.565560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.565848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.566125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.566794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.568174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.683265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 20/35] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 07:44:00 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:00.684254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.709742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 16/36] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 07:44:00 2022] POST /identity/v3/roles => generated 219 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:00.710924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.772909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.839412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b758-fa26-4d8c-8143-4d5ab8f9fc57 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.889134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb532-0442-424a-80b5-0bf7c1442d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.890199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb532-0442-424a-80b5-0bf7c1442d3b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.890698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb532-0442-424a-80b5-0bf7c1442d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.891198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb532-0442-424a-80b5-0bf7c1442d3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.893611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdb532-0442-424a-80b5-0bf7c1442d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.896262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdb532-0442-424a-80b5-0bf7c1442d3b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.898870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 21/37] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.901946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2743c7-db41-4ef5-8cd5-386dd8ed36d9 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.902460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2743c7-db41-4ef5-8cd5-386dd8ed36d9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.903094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2743c7-db41-4ef5-8cd5-386dd8ed36d9 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.905601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 22/38] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:00.906552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2743c7-db41-4ef5-8cd5-386dd8ed36d9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.906997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66857da-ebc1-4831-bbd0-645cd035c616 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.952515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca633b-7aa8-496b-b1e3-23ca7ca77679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.953100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca633b-7aa8-496b-b1e3-23ca7ca77679 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.953444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca633b-7aa8-496b-b1e3-23ca7ca77679 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.953703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca633b-7aa8-496b-b1e3-23ca7ca77679 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.954632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca633b-7aa8-496b-b1e3-23ca7ca77679 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.956287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca633b-7aa8-496b-b1e3-23ca7ca77679 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.992078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.998918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 17/39] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:44:00 2022] POST /identity/v3/projects => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:01.002975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.002975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.003265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.043458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:01.045105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:01.050603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2743c7-db41-4ef5-8cd5-386dd8ed36d9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.084602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.102169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36fb5b-4a3c-4a3d-907f-211d5e1f5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.103579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36fb5b-4a3c-4a3d-907f-211d5e1f5979 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.103870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36fb5b-4a3c-4a3d-907f-211d5e1f5979 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.104159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36fb5b-4a3c-4a3d-907f-211d5e1f5979 None admin] PATH_INFO: `/v3/domains/default/users/9c73d388b9994677b676c66beb55374b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.106417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36fb5b-4a3c-4a3d-907f-211d5e1f5979 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9c73d388b9994677b676c66beb55374b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.108726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36fb5b-4a3c-4a3d-907f-211d5e1f5979 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.133212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 23/40] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Aug 24 07:44:00 2022] PUT /identity/v3/domains/default/users/9c73d388b9994677b676c66beb55374b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:01.133212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a06d4-4410-4aae-91b7-8c43aca4d0e5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.133212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a06d4-4410-4aae-91b7-8c43aca4d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.133212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a06d4-4410-4aae-91b7-8c43aca4d0e5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.133212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 24/41] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:01.140213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.140495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.140781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.162766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:01.163232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 18/42] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:01.165321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:01.360443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 25/43] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:01.441182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.541933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7cdf4-75a0-477f-8c90-e168ad45bd22 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.570481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.577546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.578170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.578456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.578734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.579402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.580820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.595378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 19/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 07:44:01 2022] POST /identity/v3/roles => generated 223 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:01.627396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.736739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf10d-36a7-4959-9798-f8c767dca73c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.754142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.777649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc09dc-ada9-4e51-9c0f-8357dd3a8818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.778290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc09dc-ada9-4e51-9c0f-8357dd3a8818 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.778575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc09dc-ada9-4e51-9c0f-8357dd3a8818 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.778849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc09dc-ada9-4e51-9c0f-8357dd3a8818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.779959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc09dc-ada9-4e51-9c0f-8357dd3a8818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.781531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc09dc-ada9-4e51-9c0f-8357dd3a8818 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.783103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 26/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:01.789641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.890816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ef49-31cd-4df6-87a0-7216d2c7ae2e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.923386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c54d3-e2bc-432e-8962-cae43b1c0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.923987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c54d3-e2bc-432e-8962-cae43b1c0fa9 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.924270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c54d3-e2bc-432e-8962-cae43b1c0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.924544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c54d3-e2bc-432e-8962-cae43b1c0fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.925180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c54d3-e2bc-432e-8962-cae43b1c0fa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.926663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c54d3-e2bc-432e-8962-cae43b1c0fa9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.953701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 20/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:44:01 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:03.074348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d00ca-842f-45d2-832c-ea533403994e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.074885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d00ca-842f-45d2-832c-ea533403994e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.074885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d00ca-842f-45d2-832c-ea533403994e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.076246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 27/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:03.081599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.082011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.082154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.100278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:03.101471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:03.135135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.167232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 21/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:03.432730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d00ca-842f-45d2-832c-ea533403994e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.533916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d00ca-842f-45d2-832c-ea533403994e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.567429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.568065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.568353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.568631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.579063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:03.583837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:03.584764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:03.585673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 28/49] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:03.590923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.687470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e267c-50e5-4ff3-b83c-b079f4f1a672 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.719460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.720067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.720348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.720624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.721307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:03.721613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.722987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3582f-c385-45af-891c-5ee284f00606 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.735656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 22/50] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:03.741155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.783769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.840975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67467-9a63-427c-8261-4f5b5b2715ba None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.860438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872acb-f598-45c8-a5b2-b80da01de15f None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.860731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872acb-f598-45c8-a5b2-b80da01de15f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.861015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872acb-f598-45c8-a5b2-b80da01de15f None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.862417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 23/51] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:03.867258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.867545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.867818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.875873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.876518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.876804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.877082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.878263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.879747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.881392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 29/52] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:03.887165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.990101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:03.991216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:03.992872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365a153-64ae-46d5-b2dd-fc8e584ba6b6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.001974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.018289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.028315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.028956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.029241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.029635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.030764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.032634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.034251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 30/53] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:04.039949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.059822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 24/54] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:04.137698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14610a8-abe8-4444-b0bf-5b2484118a35 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.170731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.171327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.171611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.171884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.172597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.domain.id=default, user.id=9c73d388b9994677b676c66beb55374b) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:04.172906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.174364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.179929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 31/55] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 24 07:44:04 2022] GET /identity/v3/role_assignments?user.id=9c73d388b9994677b676c66beb55374b&scope.domain.id=default&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:04.324901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.426017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd4d1-66c0-4443-a1b8-3e2d1fff6aea None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.458680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e7a7d-4382-4538-8825-e56d72046872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.459309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7a7d-4382-4538-8825-e56d72046872 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.459594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7a7d-4382-4538-8825-e56d72046872 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.459873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7a7d-4382-4538-8825-e56d72046872 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.460972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7a7d-4382-4538-8825-e56d72046872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.463104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7a7d-4382-4538-8825-e56d72046872 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.464687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 25/56] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:04.470315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.510736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.566581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceb642-9de7-4451-9ba2-e46fd807d4fa None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.599172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1a36-c9c7-4550-909e-331e33eaffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.599709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1a36-c9c7-4550-909e-331e33eaffb6 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.599993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1a36-c9c7-4550-909e-331e33eaffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.600269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1a36-c9c7-4550-909e-331e33eaffb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.600902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b1a36-c9c7-4550-909e-331e33eaffb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.602461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b1a36-c9c7-4550-909e-331e33eaffb6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.629324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 32/57] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 24 07:44:04 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:44:06.506377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0ae36-f9d3-4b1c-a236-32dc88c79ffb None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.506885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0ae36-f9d3-4b1c-a236-32dc88c79ffb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.506969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0ae36-f9d3-4b1c-a236-32dc88c79ffb None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.508266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 26/58] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:06.514124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.514529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.514682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.532529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:06.533755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:06.598072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 33/59] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:06.864405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0ae36-f9d3-4b1c-a236-32dc88c79ffb None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.895427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:06.963808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0ae36-f9d3-4b1c-a236-32dc88c79ffb None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.996474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affe3e3-dd02-44b9-ae40-ad6f5598df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.997095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe3e3-dd02-44b9-ae40-ad6f5598df6b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.997408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe3e3-dd02-44b9-ae40-ad6f5598df6b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.997685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe3e3-dd02-44b9-ae40-ad6f5598df6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.998790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affe3e3-dd02-44b9-ae40-ad6f5598df6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.000220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affe3e3-dd02-44b9-ae40-ad6f5598df6b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.001791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 27/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:07.007240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.031007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:07.103730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac9d2-138d-40c3-96b8-3902767d5a60 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.136688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a39084-531b-439e-a574-209b45c4c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.137231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a39084-531b-439e-a574-209b45c4c320 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.137544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a39084-531b-439e-a574-209b45c4c320 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.137826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a39084-531b-439e-a574-209b45c4c320 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.138471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a39084-531b-439e-a574-209b45c4c320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.139902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a39084-531b-439e-a574-209b45c4c320 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.165099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 34/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:07 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:10.142104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05405-be62-4eae-bf3c-176f318ab239 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.142644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05405-be62-4eae-bf3c-176f318ab239 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.142644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05405-be62-4eae-bf3c-176f318ab239 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.144002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 28/62] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:10.149566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416080-273b-4861-8a93-0d773309ae10 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.150297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416080-273b-4861-8a93-0d773309ae10 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.150722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416080-273b-4861-8a93-0d773309ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.162514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f02e1-0eca-4940-bbea-b1deb322dcf7 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.163090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f02e1-0eca-4940-bbea-b1deb322dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.163564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f02e1-0eca-4940-bbea-b1deb322dcf7 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.165096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 29/63] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:10.171462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c156-03ac-4ec1-9332-ae0c1d305bed None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.172016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c156-03ac-4ec1-9332-ae0c1d305bed None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.172491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c156-03ac-4ec1-9332-ae0c1d305bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.197079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-19416080-273b-4861-8a93-0d773309ae10 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:10.199694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-19416080-273b-4861-8a93-0d773309ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:10.207448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c892c156-03ac-4ec1-9332-ae0c1d305bed None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:10.213467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c892c156-03ac-4ec1-9332-ae0c1d305bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:10.296801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 35/64] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:10.317963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 30/65] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:10.492357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b953e-4840-4f0e-aa6a-8e5c3de3e2b1 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.492789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b953e-4840-4f0e-aa6a-8e5c3de3e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.492965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b953e-4840-4f0e-aa6a-8e5c3de3e2b1 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.495034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 36/66] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:10.509726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e38d1-6772-47b0-90c1-0be633d146aa None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.510257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e38d1-6772-47b0-90c1-0be633d146aa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.510734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e38d1-6772-47b0-90c1-0be633d146aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.538271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ac6e38d1-6772-47b0-90c1-0be633d146aa None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:10.539835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ac6e38d1-6772-47b0-90c1-0be633d146aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:10.565998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.612016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b953e-4840-4f0e-aa6a-8e5c3de3e2b1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.625588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.626598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 31/67] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:10.646175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e4f6-8ab0-44df-8e72-19c5df947ff9 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.646470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e4f6-8ab0-44df-8e72-19c5df947ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.646754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e4f6-8ab0-44df-8e72-19c5df947ff9 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.648214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 32/68] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:10.663941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.664231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.664514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.688254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:10.689818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:10.756107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b953e-4840-4f0e-aa6a-8e5c3de3e2b1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.760031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 33/69] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 07:44:10.761183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.806757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.807638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.808263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.808677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.822836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:10.828026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:10.829078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:10.829996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:10.831880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 37/70] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:10.837594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.855068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.864849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486f497-0eb0-4184-9f6b-9c55fae0e62e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.901199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.902217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.902694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.903162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.914775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:10.915359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:10.922957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:10.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:10.924564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:10.926859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:10.935323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.953092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a145a1-5247-4f03-992c-30f0d30c470a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.989359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.989981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.990257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.990529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.991186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:10.991487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.992865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce502d4-6dd8-47cd-8cf2-871c13aec137 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.001948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 38/72] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.007029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c591-1e0f-4de0-b87f-a59d2e3928d9 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.007371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c591-1e0f-4de0-b87f-a59d2e3928d9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.007730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c591-1e0f-4de0-b87f-a59d2e3928d9 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.009808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 39/73] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:11.015680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c591-1e0f-4de0-b87f-a59d2e3928d9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.046401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796e9f-9868-4060-8be7-d5822d6c393e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.083448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.084059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.084346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.084628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.085320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:11.085636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.087105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.095450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 35/74] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.096087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.111539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.127569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c591-1e0f-4de0-b87f-a59d2e3928d9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.156228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.162919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b582f3-b270-4516-ba94-b855c9740839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.163555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b582f3-b270-4516-ba94-b855c9740839 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.163843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b582f3-b270-4516-ba94-b855c9740839 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.164129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b582f3-b270-4516-ba94-b855c9740839 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.175160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b582f3-b270-4516-ba94-b855c9740839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-b2b582f3-b270-4516-ba94-b855c9740839 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:11.179916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:11.181395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:11.182158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 40/75] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:11.182788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.183097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.183393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.200518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:11.201970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:11.203307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32af9fd-247a-4efb-a1d7-7c16f274df74 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.236605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.237241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.237555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.237834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.239198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.240659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.242282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 36/76] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.243069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.270058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 41/77] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:11.274245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.329375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.355345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4354-8614-417e-acd7-3122d2565499 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.391209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba291c-5478-4f46-a249-679578b87ce3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.391773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.392413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.392698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.392981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.408979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.410804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.412689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.412796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 37/78] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.413661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.433103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.433779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.434065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.434341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.445058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:11.450423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:11.451267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:11.452024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 42/79] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:11.457015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.517841 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06b9d4-7fe0-4858-a68a-416bd1a692fb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.553580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.554122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.554404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.554685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.555338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:11.555641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.557563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.560084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79383-7552-45eb-ac13-f3d74c2a8baf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.562453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.569555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 38/80] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.570253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.594833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.595437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.595717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.595987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.643088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.664021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.666123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.669901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5f285-4c86-4f8b-b190-c14b52a95188 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.703912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.704876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.705166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.705477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.763144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 43/81] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:11.764054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.774403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.778184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.779673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.842197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.861605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af769ca-0c5f-45e7-a2ad-fcf8417fb031 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.877795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:11.878788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.894997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.895861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.896144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.896418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.897074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:11.897410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.898864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.907230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 44/83] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.908000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.978275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.981390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95981-cb81-40b3-af20-4089972cdf03 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.006332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b845a-9915-492a-a93c-abfd5fef5fec None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.016672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.017330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.017615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.017889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.018990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.020676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.022270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 40/84] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.023036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.039530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.040693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.040978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.041253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.042392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.043826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.045412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 45/85] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.046160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.058567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.125715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328197-45ca-4ebd-9273-dda5f1ba2fd1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.144329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaa2c-912d-43b9-8f8b-380b0c5409ca None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.159134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.159765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.160048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.160326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.161476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.162909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.164534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 41/86] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.165847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.179741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.180394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.180684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.181568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.182691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.184166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.185889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 46/87] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.190099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.200817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.263624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2b44d-e02c-445d-894e-45d0e9c29b91 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.266328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.290055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd4e98-9a4a-4dbe-afce-dd57b3078b1b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.297767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.298398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.298680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.298966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.300105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.301572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.303153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 42/88] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.306217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.323777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.324380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.324661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.324928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.325608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.327041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.350784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 47/89] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:12 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:12.351701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.422655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2619-144d-4060-b22d-f0570ef78388 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.426513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.465010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.466052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.466345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.466903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.471477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f80ce-86ce-4bea-967b-9529f97c7793 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.513792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.514410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.514693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.515285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.515698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=9c73d388b9994677b676c66beb55374b) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:12.516628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.517641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.519663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.524973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 48/90] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/role_assignments?user.id=9c73d388b9994677b676c66beb55374b&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.525846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.572238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.574025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.679448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e94843-f917-44ed-845e-b5c8f7ea52a3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.716914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 43/91] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:12.721343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.721620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.732869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.733540 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.734098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.734382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.735603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=252406ca8b22416f82b7bdbeb1bf87d5) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:12.735930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.737698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.747501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 49/92] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/role_assignments?user.id=252406ca8b22416f82b7bdbeb1bf87d5&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=b191ebef2f53453e846b638562cda626 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.747501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.830748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.887127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdda711-074f-4a80-8289-2b93130c4245 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.925237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1c2d-6867-4115-95bf-3c6e2b9533ae None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.932193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.932773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.933055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.933353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.938069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.939604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.941515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 50/93] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.947447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.997899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.998964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.999261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.999542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:13.097809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82b37-1b30-41c2-989a-d41db64c8e71 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:13.135725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:13.142263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:13.142976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:13.143338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:13.143697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:13.144503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] RBAC: Adding query filter params (role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=252406ca8b22416f82b7bdbeb1bf87d5) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:13.144950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:13.147484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:13.154869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 51/94] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/role_assignments?user.id=252406ca8b22416f82b7bdbeb1bf87d5&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:13.166087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:13.167809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:13.171006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:13.285474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 44/95] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:13.288261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:13.422957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827daade-c695-4489-8be8-19ac6df94bf0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:13.459681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfaf6b-fed0-4048-bb9e-8f0211cc1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:13.460385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfaf6b-fed0-4048-bb9e-8f0211cc1d03 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:13.460671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfaf6b-fed0-4048-bb9e-8f0211cc1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:13.460954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfaf6b-fed0-4048-bb9e-8f0211cc1d03 None admin] PATH_INFO: `/v3/projects/1cb8fa8d344448109c9edff1c089fb14` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:13.462737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfaf6b-fed0-4048-bb9e-8f0211cc1d03 None admin] RBAC: Authorizing `identity:get_project(project_id=1cb8fa8d344448109c9edff1c089fb14)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:13.464211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfaf6b-fed0-4048-bb9e-8f0211cc1d03 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:13.466096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 52/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:13 2022] GET /identity/v3/projects/1cb8fa8d344448109c9edff1c089fb14 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:13.472161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:13.578176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06866-b674-4239-83bc-7fdb50765254 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:13.586177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:13.626177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:13.626800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:13.627083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:13.627359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:13.628091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, scope.project.id=1cb8fa8d344448109c9edff1c089fb14, user.id=252406ca8b22416f82b7bdbeb1bf87d5) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:13.628401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:13.629864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020608-77da-4b1d-8d71-36c9ce69bfe5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:13.644206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 45/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:13 2022] GET /identity/v3/role_assignments?user.id=252406ca8b22416f82b7bdbeb1bf87d5&scope.project.id=1cb8fa8d344448109c9edff1c089fb14&role.id=b191ebef2f53453e846b638562cda626 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:14.902648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a29db-b0dd-4de1-bb68-24914c2fa877 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:14.903176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a29db-b0dd-4de1-bb68-24914c2fa877 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:14.903176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a29db-b0dd-4de1-bb68-24914c2fa877 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:14.904539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 53/98] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:14.909987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94f19a-c292-4d33-88ca-dc1b12e06b2a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:14.910377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94f19a-c292-4d33-88ca-dc1b12e06b2a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:14.910538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94f19a-c292-4d33-88ca-dc1b12e06b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:14.938222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1f94f19a-c292-4d33-88ca-dc1b12e06b2a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:14.939444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1f94f19a-c292-4d33-88ca-dc1b12e06b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:15.017864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 46/99] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:15.296245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1cfe-7f26-43b8-be95-6be702fd5c4e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.296631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1cfe-7f26-43b8-be95-6be702fd5c4e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.296807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1cfe-7f26-43b8-be95-6be702fd5c4e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.298171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 54/100] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:15.306514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7be69-bbc0-433d-87d2-6e2a50cbbd5c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.306805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7be69-bbc0-433d-87d2-6e2a50cbbd5c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.307082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7be69-bbc0-433d-87d2-6e2a50cbbd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.330276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-78c7be69-bbc0-433d-87d2-6e2a50cbbd5c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:15.331488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-78c7be69-bbc0-433d-87d2-6e2a50cbbd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:15.431597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 47/101] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:15.556711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1cfe-7f26-43b8-be95-6be702fd5c4e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.604626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d204d-a57b-42af-b638-1c8039f24412 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.604940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d204d-a57b-42af-b638-1c8039f24412 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.605208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d204d-a57b-42af-b638-1c8039f24412 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.607179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 48/102] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:15.612457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.612985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.613528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.641290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:15.643037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:15.644762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:15.694396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:15.711086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1cfe-7f26-43b8-be95-6be702fd5c4e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:15.765702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:15.766703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.767176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.767661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.768964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:15.771282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:15.773053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 55/103] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:15.779987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.795956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 49/104] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:15.865598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.908044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519cba2-ba63-4bbd-b954-18dee0751b76 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:15.962544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:15.973942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29103532-8c23-4f8b-8ebf-18c59ed6b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:15.974564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103532-8c23-4f8b-8ebf-18c59ed6b12c None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.974848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103532-8c23-4f8b-8ebf-18c59ed6b12c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.975127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103532-8c23-4f8b-8ebf-18c59ed6b12c None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.975770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29103532-8c23-4f8b-8ebf-18c59ed6b12c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:15.977214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29103532-8c23-4f8b-8ebf-18c59ed6b12c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.030761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 56/105] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/projects => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:44:16.048675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16ff2c-1065-4e0d-9508-e01f3c57077a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.096011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c306f8-d6d8-4bec-89d6-9d365bc91d5e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.096313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c306f8-d6d8-4bec-89d6-9d365bc91d5e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.096575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c306f8-d6d8-4bec-89d6-9d365bc91d5e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.098056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 57/106] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:16.104364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.104651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.104925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.110530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.111195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.113387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.113677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.133513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:16.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:16.141868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:16.151889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:16.152793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:16.153588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:16.158542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 50/107] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:16.162401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.215774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.271875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 58/108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:16.273284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.322761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948805f-d4ae-4f1b-8e45-d05c762c194a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.363528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.364143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.364427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.364710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.365417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:16.365979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.368893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d87a-af91-4d59-bd8e-4e20f96dce9a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.384959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 51/109] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:16.386788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f969a-b53a-4f04-b77c-3a5150111e70 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.387286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f969a-b53a-4f04-b77c-3a5150111e70 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.387763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f969a-b53a-4f04-b77c-3a5150111e70 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.389382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 52/110] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:16.393998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f969a-b53a-4f04-b77c-3a5150111e70 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.442943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f57a8-f481-4c5e-b4fb-f39b4837da48 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.462981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.492679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2c68d-5919-4ff8-8395-16cff2057942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.493725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2c68d-5919-4ff8-8395-16cff2057942 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.494011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2c68d-5919-4ff8-8395-16cff2057942 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.494288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2c68d-5919-4ff8-8395-16cff2057942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.520101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2c68d-5919-4ff8-8395-16cff2057942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d3a2c68d-5919-4ff8-8395-16cff2057942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:16.527164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:16.528070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:16.528911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:16.531614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 59/111] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:16.533166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.533647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.534379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.539258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.544427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f969a-b53a-4f04-b77c-3a5150111e70 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.556287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:16.557769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:16.581583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cce08-3d51-46ed-870d-af1b8acf8b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.582430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cce08-3d51-46ed-870d-af1b8acf8b56 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.582898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cce08-3d51-46ed-870d-af1b8acf8b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.583315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cce08-3d51-46ed-870d-af1b8acf8b56 None admin] PATH_INFO: `/v3/users/215f932ddd4e4ae3a5351f1cd940e76e` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.598139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cce08-3d51-46ed-870d-af1b8acf8b56 None admin] RBAC: Authorizing `identity:get_user(user_id=215f932ddd4e4ae3a5351f1cd940e76e)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.599791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cce08-3d51-46ed-870d-af1b8acf8b56 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.601756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 53/112] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/users/215f932ddd4e4ae3a5351f1cd940e76e => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:16.603210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6479d-472a-4f5e-9d8e-8c6b21850a9f None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.603674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6479d-472a-4f5e-9d8e-8c6b21850a9f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.604123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6479d-472a-4f5e-9d8e-8c6b21850a9f None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.606640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 54/113] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:16.607543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6479d-472a-4f5e-9d8e-8c6b21850a9f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.644335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 60/114] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:16.645287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.735049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6479d-472a-4f5e-9d8e-8c6b21850a9f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.764379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85829644-84ff-4c66-9da1-f226634c6f1a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.766768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.780670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.781559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.781913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.782262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.783365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:16.783745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.785698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f26c61-3c61-4071-9015-beda6c96b762 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.792677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.798715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 55/115] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:16.800135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.800427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.800708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.807818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.808752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.809316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.809794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.820949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:16.822839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:16.893663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.895970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.915624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 56/116] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:16.915624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.017134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 61/117] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:17.018456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.023427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.029705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506214-1b9c-46b0-9828-4e2ef5fda1b5 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.060583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.068170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.068915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.069316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.069731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.083390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:17.088285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:17.089128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:17.089944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:17.090522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 57/118] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:17.091622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.149465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97825bdd-4a10-4783-95d4-d7530af96e82 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.188110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.188806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.189136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.189492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.190681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.192161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.193775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 62/119] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.197561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.222383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174870f9-c24b-4f0a-9abc-5f29f956035e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.256755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.257415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.257698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.257972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.268799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:17.273791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:17.275433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 58/120] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:17.276400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.283968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.317529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955d5ec-cb08-43d3-a4b0-01c814c90e03 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.347418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.359286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.359929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.360208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.360480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.361972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.363401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.365240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.365810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.398795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56915fd-030c-40e1-b973-85f305938fb1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.437069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.437724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.438000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.438282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.439038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:17.439252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.440620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.448673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 59/122] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.453237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.486556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1229-5a1a-41f2-8946-d23d514de395 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.525828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.527190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.527479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.527757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.535863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.539943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:17.544633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:17.545690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:17.546494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:17.549342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 64/123] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:17.550100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.560774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bfa3c-a12b-48ec-a848-a5adedd1064f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.575297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.598353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.598794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.599077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.599356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.600485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.602057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.608484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 60/124] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.608484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.657905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799d8c-68c8-429b-9543-9de911ab2035 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.693872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.694409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.694693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.694973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.695624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:17.695929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.698045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.712417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 65/125] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.712417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.717416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65168e-1455-432d-aa35-1a4a00aaae3e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.757395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.758083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.758279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.758558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.759939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] RBAC: Adding query filter params (role.id=e7d2252b67e04fa9a70eed19733d834c, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=215f932ddd4e4ae3a5351f1cd940e76e) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:17.760543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.761741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.777308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 61/126] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/role_assignments?user.id=215f932ddd4e4ae3a5351f1cd940e76e&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=e7d2252b67e04fa9a70eed19733d834c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.777308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.791895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.836098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.851415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411469f0-7c46-4ca1-b0f9-d87548fbd16a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.893052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.894194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.894537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.896052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.897630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.899620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 66/127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.900461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.917818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1183d-a70e-4385-a840-466269b78ae9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.965459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.966095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.966450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.967335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.968013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:17.968321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.969752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.979383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 62/128] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:17.980530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.022640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee15ca-b077-4937-a723-ff33551cdc09 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.059135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.070537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.071490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.071778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.072059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/9c73d388b9994677b676c66beb55374b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.074582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a9edcab5a4ec2997ce4702f7f3051, user_id=9c73d388b9994677b676c66beb55374b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.076580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.089479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68d6ce-e603-4700-a374-ecbdcc81b3b2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.092684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 67/129] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:17 2022] PUT /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/9c73d388b9994677b676c66beb55374b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:18.100999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.101951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.132350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.132903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.133305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.133813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.135125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.136845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.142605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 63/130] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:18.142605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.282946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5592c4-854f-47d0-b19c-b6e4dfd0624a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.302997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d530310-70fc-4afb-9833-09b5a506f02e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.326019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.326730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.327483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.327765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.328942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.330462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.332059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 64/131] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:18 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:18.332823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.353303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d505bf0-112a-4261-8544-b1cc6ea72c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.353303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d505bf0-112a-4261-8544-b1cc6ea72c23 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.353303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d505bf0-112a-4261-8544-b1cc6ea72c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.353303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d505bf0-112a-4261-8544-b1cc6ea72c23 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.354075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d505bf0-112a-4261-8544-b1cc6ea72c23 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.355534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d505bf0-112a-4261-8544-b1cc6ea72c23 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.357395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 68/132] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:18 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:18.358877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a13fa-cb98-4005-a031-c784acd5dfb8 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.358877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a13fa-cb98-4005-a031-c784acd5dfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.359098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a13fa-cb98-4005-a031-c784acd5dfb8 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.364225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 69/133] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:18.364225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a13fa-cb98-4005-a031-c784acd5dfb8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.408257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.428817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.482856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a4182-9d52-4d86-9fd5-d62df8b33094 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.491245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a13fa-cb98-4005-a031-c784acd5dfb8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.531446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.532562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.533152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.533712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.535282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.535545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444b91-8c3d-4152-ae5c-888dd64d6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.536256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444b91-8c3d-4152-ae5c-888dd64d6bed None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.536618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444b91-8c3d-4152-ae5c-888dd64d6bed None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.536970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444b91-8c3d-4152-ae5c-888dd64d6bed None admin] PATH_INFO: `/v3/projects/1cb8fa8d344448109c9edff1c089fb14` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.537877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.538275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a444b91-8c3d-4152-ae5c-888dd64d6bed None admin] RBAC: Authorizing `identity:get_project(project_id=1cb8fa8d344448109c9edff1c089fb14)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.539765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a444b91-8c3d-4152-ae5c-888dd64d6bed None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.540223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 65/134] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:18 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:18.545290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.545414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 70/135] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:18 2022] GET /identity/v3/projects/1cb8fa8d344448109c9edff1c089fb14 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:18.545414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.545414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.545414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.572103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:18.573327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:18.669100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 71/136] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:18.669100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.674361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2f55-556d-4982-865a-d061ab6203b9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.686046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.710432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.711265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.711644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.712052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/252406ca8b22416f82b7bdbeb1bf87d5/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.714400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a9edcab5a4ec2997ce4702f7f3051, user_id=252406ca8b22416f82b7bdbeb1bf87d5, role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.715957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.744233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 66/137] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:18 2022] PUT /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/252406ca8b22416f82b7bdbeb1bf87d5/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:18.745048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.780200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.832074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621338-e7da-4906-b141-4cc6e45973aa None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.870416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.871461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.872046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.872526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/252406ca8b22416f82b7bdbeb1bf87d5/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.874787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a9edcab5a4ec2997ce4702f7f3051, user_id=252406ca8b22416f82b7bdbeb1bf87d5, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.876453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.898383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 72/138] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:18 2022] PUT /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/252406ca8b22416f82b7bdbeb1bf87d5/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:18.953189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab7a8-8fe7-4702-8dbe-5f44da5cc570 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.006986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.007671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.007957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.008247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] PATH_INFO: `/v3/projects/1cb8fa8d344448109c9edff1c089fb14/users/252406ca8b22416f82b7bdbeb1bf87d5/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.011868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] RBAC: Authorizing `identity:create_grant(project_id=1cb8fa8d344448109c9edff1c089fb14, user_id=252406ca8b22416f82b7bdbeb1bf87d5, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.013531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.033100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:18 2022] PUT /identity/v3/projects/1cb8fa8d344448109c9edff1c089fb14/users/252406ca8b22416f82b7bdbeb1bf87d5/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:19.141961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.259490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876945-ad53-43b6-8e7b-57d28d003fb7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.277074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.302305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fa32-88a0-41ca-a310-c7a4b9fcee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.303313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa32-88a0-41ca-a310-c7a4b9fcee3a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.303791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa32-88a0-41ca-a310-c7a4b9fcee3a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.304261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa32-88a0-41ca-a310-c7a4b9fcee3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.305785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fa32-88a0-41ca-a310-c7a4b9fcee3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.307542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fa32-88a0-41ca-a310-c7a4b9fcee3a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.309870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 73/140] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:19.315631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.351739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.427373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a8653-0833-422e-aaa1-be981aca75fc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.463534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123293f7-31c7-4f2c-bd9e-1dd2764b80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.464308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123293f7-31c7-4f2c-bd9e-1dd2764b80ad None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.464695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123293f7-31c7-4f2c-bd9e-1dd2764b80ad None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.465093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123293f7-31c7-4f2c-bd9e-1dd2764b80ad None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.465880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123293f7-31c7-4f2c-bd9e-1dd2764b80ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.467424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123293f7-31c7-4f2c-bd9e-1dd2764b80ad None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.496827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 68/141] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:19 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:20.117136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279ad17-ee94-4e9a-a119-a942f6cd8a4a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.117565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279ad17-ee94-4e9a-a119-a942f6cd8a4a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.117736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279ad17-ee94-4e9a-a119-a942f6cd8a4a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.119316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 74/142] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:20.124559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c7b56-3bb4-4cfb-a4be-0b0949429b67 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.124856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c7b56-3bb4-4cfb-a4be-0b0949429b67 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.125195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c7b56-3bb4-4cfb-a4be-0b0949429b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.150056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-463c7b56-3bb4-4cfb-a4be-0b0949429b67 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:20.151271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-463c7b56-3bb4-4cfb-a4be-0b0949429b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:20.246302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 69/143] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:20.599022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb4e7-d2d0-4472-9c7d-3c1c6ffe02d0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.599547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb4e7-d2d0-4472-9c7d-3c1c6ffe02d0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.599547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb4e7-d2d0-4472-9c7d-3c1c6ffe02d0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.600892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 75/144] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:20.606382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.606792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.606999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.626947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:20.628209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:20.640550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.718076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 70/145] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:20.803844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb4e7-d2d0-4472-9c7d-3c1c6ffe02d0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.937377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb4e7-d2d0-4472-9c7d-3c1c6ffe02d0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.975987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.976641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.976925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.977527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.994704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:20.999694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.001795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:21.003649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 76/146] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.009290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.123912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc24b7-fae1-45ca-bca4-27a97cb61c7b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.167968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.168596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.168883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.169229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.169935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.170252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.171640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.186082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 71/147] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.191959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.240380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.302602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c96900-7870-4954-b4e5-b5893c8f7010 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.329544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.351618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.357623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.358278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.358556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.358832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] PATH_INFO: `/v3/users/215f932ddd4e4ae3a5351f1cd940e76e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.360104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] RBAC: Authorizing `identity:get_user(user_id=215f932ddd4e4ae3a5351f1cd940e76e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.361665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.365727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 77/148] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/users/215f932ddd4e4ae3a5351f1cd940e76e => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.371554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.541093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d0740-780e-48ab-878f-0935f1abcbd9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.567283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82898-3614-445c-8f9c-26127c128aee None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.588957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.590444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.591107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.591387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.591663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.619340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:21.624131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.625175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:21.626295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:21.628158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 72/149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:21.632457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.651377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.652030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.652311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.652583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.655617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.657093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.658823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 78/150] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.664721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.745667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.793216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90a20e-277b-4957-ae6a-d9b3b57dcdd0 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.843214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.843822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.844098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.844366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.845027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.845340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.846720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.859960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 73/151] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.865053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.906670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9c13-f592-4bda-99e5-e8dd44f196b6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.985941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.986622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.986900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.987220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/215f932ddd4e4ae3a5351f1cd940e76e/roles/e7d2252b67e04fa9a70eed19733d834c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.994724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a9edcab5a4ec2997ce4702f7f3051, user_id=215f932ddd4e4ae3a5351f1cd940e76e, role_id=e7d2252b67e04fa9a70eed19733d834c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.996376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.001551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17a0f-39da-4940-b4cf-d1049b581bd4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.018911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 79/152] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:21 2022] PUT /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/users/215f932ddd4e4ae3a5351f1cd940e76e/roles/e7d2252b67e04fa9a70eed19733d834c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:22.065391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.076645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a7a1-4490-4ca6-9521-7392e61da9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.077637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a7a1-4490-4ca6-9521-7392e61da9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.077637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a7a1-4490-4ca6-9521-7392e61da9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.077927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a7a1-4490-4ca6-9521-7392e61da9c3 None admin] PATH_INFO: `/v3/users/9c73d388b9994677b676c66beb55374b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.079065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07a7a1-4490-4ca6-9521-7392e61da9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=9c73d388b9994677b676c66beb55374b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.080516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07a7a1-4490-4ca6-9521-7392e61da9c3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.082171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 74/153] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/users/9c73d388b9994677b676c66beb55374b => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:22.088598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.155971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.246500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763339b1-bcd3-4a55-94e4-a3d1b8386112 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.276274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b6d2-d16a-41d0-8cc6-22cac3315982 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.276585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b6d2-d16a-41d0-8cc6-22cac3315982 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.276832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b6d2-d16a-41d0-8cc6-22cac3315982 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.278499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 75/154] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:22.286907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46356-8a5a-436e-b999-b6ffd701a092 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.287123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46356-8a5a-436e-b999-b6ffd701a092 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.287332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae46356-8a5a-436e-b999-b6ffd701a092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.300796 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.301455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.301736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.302012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.326381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-dae46356-8a5a-436e-b999-b6ffd701a092 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:22.327551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-dae46356-8a5a-436e-b999-b6ffd701a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:22.429892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.431339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 76/155] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:22.432075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970c78-c177-4b9e-89fe-6e5778172551 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.432365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970c78-c177-4b9e-89fe-6e5778172551 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.432644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970c78-c177-4b9e-89fe-6e5778172551 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.433682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.442352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 77/156] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:22.444601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4b2c3-4c1f-490b-b843-783f40f080e1 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.444914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4b2c3-4c1f-490b-b843-783f40f080e1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.445201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4b2c3-4c1f-490b-b843-783f40f080e1 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.446836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 78/157] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:22.447936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5ccb-dc2c-4171-b1bb-b406bdbe3f46 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.448223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5ccb-dc2c-4171-b1bb-b406bdbe3f46 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.448495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5ccb-dc2c-4171-b1bb-b406bdbe3f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.482895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-377a5ccb-dc2c-4171-b1bb-b406bdbe3f46 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:22.484260 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-377a5ccb-dc2c-4171-b1bb-b406bdbe3f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:22.510507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.619484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:22.621204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.621524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.621811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.655745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:22.657116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:22.677674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 80/159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:22.690801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.749628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.776761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 80/160] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:22.855370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bafd-7f69-4484-8a92-9fdd53004706 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.902355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.903325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.903821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.904299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.905769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.907508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.909358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 81/161] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:22.915560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.065005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bff6d-946d-4693-a014-cb34d25a207a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.077548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.093286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.110958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.111580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.111863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.112143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.112877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=9c73d388b9994677b676c66beb55374b) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:23.113368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.115159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.125724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 81/162] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/role_assignments?user.id=9c73d388b9994677b676c66beb55374b&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:23.236848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8246-7b8c-4e85-aa4c-374db1080b6a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.280553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.281610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.282095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.282569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.296906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:23.306714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.307679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:23.308445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:23.311143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.316470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.316716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.448492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.476492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.553884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f5ec-a8e3-4315-b726-f8240c659125 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.570832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27cd3d-0c25-4dfe-8d62-73cde8e4a061 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.630020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.630877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.631160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.631434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.637507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.638121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.638405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.638682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.639349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:23.639655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.641030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.663206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:23.668528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.669477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:23.670246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 83/164] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.670874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.680198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 82/165] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:23.681547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.844193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6682a2b-dd8b-4b4e-acbb-fdf944ed3086 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.845020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3dba-eb28-40b2-a1e2-2c6b9ffad437 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.871919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.884635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.902563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.903220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.903504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.903777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.920570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:23.921945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.922566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.922850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.923129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.923799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:23.924106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.925522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:23.925922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.926786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:23.927563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 84/166] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.929015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.943509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 83/167] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:23.944293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.066272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb38465-af74-42db-8bcc-881bbc41a331 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.110068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.111166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.111653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.112824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.114356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.117419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.121734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 85/168] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.122945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.155021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e36ba-d3df-40ff-9f71-4e90abfe2ffc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.217432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.218444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.218939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.219415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.220287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.222005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.223607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e87647-2cb5-4568-9448-a917c1f707a2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.225595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.239765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 84/169] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.242305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c3e4-967a-4774-89d3-5d920e7eaf67 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.242592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c3e4-967a-4774-89d3-5d920e7eaf67 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.242876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c3e4-967a-4774-89d3-5d920e7eaf67 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.247188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 85/170] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:24.247989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c3e4-967a-4774-89d3-5d920e7eaf67 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.307270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a057a39-4bd2-47b2-aead-accb313b28cb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.324324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.368720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46103bd0-034d-48a1-b1d5-109e6203bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.369289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46103bd0-034d-48a1-b1d5-109e6203bc48 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.369574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46103bd0-034d-48a1-b1d5-109e6203bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.369843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46103bd0-034d-48a1-b1d5-109e6203bc48 None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.371081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46103bd0-034d-48a1-b1d5-109e6203bc48 None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.374938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46103bd0-034d-48a1-b1d5-109e6203bc48 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.376523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 86/171] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.384364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.386282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.386566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.423238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:24.424440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:24.442921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c3e4-967a-4774-89d3-5d920e7eaf67 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.505646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.506491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.508413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.509270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.545920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 87/172] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:24.546703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.586466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.588069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.605519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.629165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.669212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9bb8d-9e09-4a1f-8eb3-42e5ca7e4c6e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.695498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 86/173] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:24.696664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.718080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e3980-62bf-4776-9d51-83f355e4deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.718724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e3980-62bf-4776-9d51-83f355e4deef None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.719004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e3980-62bf-4776-9d51-83f355e4deef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.719277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e3980-62bf-4776-9d51-83f355e4deef None admin] PATH_INFO: `/v3/users/252406ca8b22416f82b7bdbeb1bf87d5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.720514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e3980-62bf-4776-9d51-83f355e4deef None admin] RBAC: Authorizing `identity:get_user(user_id=252406ca8b22416f82b7bdbeb1bf87d5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.722107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e3980-62bf-4776-9d51-83f355e4deef None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.724038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 88/174] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/users/252406ca8b22416f82b7bdbeb1bf87d5 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.725235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588ce6-5db5-495e-acf3-ada9c0b30b4d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.725539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588ce6-5db5-495e-acf3-ada9c0b30b4d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.725811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588ce6-5db5-495e-acf3-ada9c0b30b4d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.727286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 89/175] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:24.732434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2e38b-5af0-4add-8e79-abfffff78496 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.732754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2e38b-5af0-4add-8e79-abfffff78496 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.733098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2e38b-5af0-4add-8e79-abfffff78496 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.734610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 90/176] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:24.735149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2e38b-5af0-4add-8e79-abfffff78496 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.807890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126014-8bab-4cfe-b0e5-10381a182984 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.843020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ba289-5dc0-4ef1-aa7e-ae81ab25d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.843634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ba289-5dc0-4ef1-aa7e-ae81ab25d07f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.844017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ba289-5dc0-4ef1-aa7e-ae81ab25d07f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.844399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ba289-5dc0-4ef1-aa7e-ae81ab25d07f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.845389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2e38b-5af0-4add-8e79-abfffff78496 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.854026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.870223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.887071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.887699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.888435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.888714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] PATH_INFO: `/v3/projects/1cb8fa8d344448109c9edff1c089fb14` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.890225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] RBAC: Authorizing `identity:get_project(project_id=1cb8fa8d344448109c9edff1c089fb14)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.892010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.897429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 91/177] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/projects/1cb8fa8d344448109c9edff1c089fb14 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.897429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.926996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ba289-5dc0-4ef1-aa7e-ae81ab25d07f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.928751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ba289-5dc0-4ef1-aa7e-ae81ab25d07f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.001141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8114e-8ae1-4c57-b1a1-a188ae78dddc None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.038062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.038672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.038952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.039222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.041327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 87/178] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:25.042959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa70c3-8870-4336-9641-87a7b13b613a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.043517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa70c3-8870-4336-9641-87a7b13b613a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.044014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa70c3-8870-4336-9641-87a7b13b613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.062566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-64aa70c3-8870-4336-9641-87a7b13b613a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:25.063766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-64aa70c3-8870-4336-9641-87a7b13b613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:25.095310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.099649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.115091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.116566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.138438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 88/179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:25.142575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.142933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.143294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.161517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:25.162683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:25.230753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 92/180] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:25.231696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.237388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 89/181] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:25.238249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.322188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.335135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd81a-389e-4e9b-a3ef-7c07454fddd7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.344181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.349934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b58a-6735-4346-9b53-558626dab12b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.383806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.384471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.384745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.385010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.388434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.389347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.389843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.390311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.391437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, scope.project.id=1cb8fa8d344448109c9edff1c089fb14, user.id=252406ca8b22416f82b7bdbeb1bf87d5) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:25.391958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.393661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dd36-bc29-487d-a0aa-1a3eeabbc361 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.395282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:25.400726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:25.401687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:25.402506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 93/183] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:25.403222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.404018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 90/183] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/role_assignments?user.id=252406ca8b22416f82b7bdbeb1bf87d5&scope.project.id=1cb8fa8d344448109c9edff1c089fb14&role.id=b191ebef2f53453e846b638562cda626 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.405616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037259b6-93f7-430d-985f-64462f9819c0 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.406108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037259b6-93f7-430d-985f-64462f9819c0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.406590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037259b6-93f7-430d-985f-64462f9819c0 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.408135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 91/184] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:25.409028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037259b6-93f7-430d-985f-64462f9819c0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.519242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3da51-d215-4d99-a809-ad804601fea4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.522133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037259b6-93f7-430d-985f-64462f9819c0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.561020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.562000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.562457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.562872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.563099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.563509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.563782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.564049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.564418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.565205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.565895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.566669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.567854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 92/185] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.568276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 94/186] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.569027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.573911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.591235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.612136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.681629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8c12b-69d0-4276-8a4b-8176517dc338 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.686997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db96b7-0674-47cf-8ee1-6732b4d5129a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.715755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.716357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.716637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.716906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.717591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:25.717890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.719272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.719586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b989-bcde-4f71-b2da-6994b40d28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.720219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b989-bcde-4f71-b2da-6994b40d28d1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.720502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b989-bcde-4f71-b2da-6994b40d28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.720774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b989-bcde-4f71-b2da-6994b40d28d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.721894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347b989-bcde-4f71-b2da-6994b40d28d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.723317 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347b989-bcde-4f71-b2da-6994b40d28d1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.724896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.726013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.726296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.726572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.731613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 95/188] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.731613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.744663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:25.745897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:25.806915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.812306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 94/189] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:25.813143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.836082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639aa4-f07e-4610-a356-514a6f01e6a1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.840821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.872864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.873520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.873805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.874079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.885475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:25.890633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:25.891535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:25.892403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 96/190] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:25.893080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.921784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02e0b-f39f-470a-a04c-f2118a4f73e7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.957172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.957909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.958478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.958778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.959509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] RBAC: Adding query filter params (role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=252406ca8b22416f82b7bdbeb1bf87d5) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:25.959824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.961284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.968073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 95/191] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/role_assignments?user.id=252406ca8b22416f82b7bdbeb1bf87d5&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.968837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.014728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0db9c-9d50-4772-a255-8ac959bbc7c0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.064658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.065485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.065867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.066240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.067610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=252406ca8b22416f82b7bdbeb1bf87d5) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.068026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.070104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.073628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.079868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/role_assignments?user.id=252406ca8b22416f82b7bdbeb1bf87d5&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=b191ebef2f53453e846b638562cda626 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.082208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.082925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba224-f980-4b00-bdb1-eec8bd6f1a87 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.094250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.136667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.137353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.137635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.137915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.138577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.140091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.173867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 96/193] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:25 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:26.178221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.234791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca81e2-c181-4f1c-aedf-441f84444aa8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.287141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.287836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.288119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.288396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] PATH_INFO: `/v3/users/bf6046311d534d7380fb44cbf991377c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.313154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] RBAC: Authorizing `identity:get_user(user_id=bf6046311d534d7380fb44cbf991377c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.314712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.316446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/users/bf6046311d534d7380fb44cbf991377c => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.317237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.335757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dd168-623d-465b-acb6-d6e3c77258e2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.382347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.383009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.383293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.383596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.384273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.384580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.386185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.395112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 97/195] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.396122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.400583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.412016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.456295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d2056-f83e-4fbd-a06a-42226be28c2d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.502531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.503095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.503372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.503640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.515298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:26.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:26.521467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:26.522256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:26.522925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.523712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4c4fb-3f50-4ee6-87e4-ddbbdff88393 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.570407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.570407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.570407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.570765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.646758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.648228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.658337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de04c-83ef-4cf0-b408-ed3ed83153de None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.661245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.689783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.710523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.711786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.712519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.713040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] PATH_INFO: `/v3/users/bf6046311d534d7380fb44cbf991377c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.715090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] RBAC: Authorizing `identity:get_user(user_id=bf6046311d534d7380fb44cbf991377c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.716528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.718146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 100/197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/users/bf6046311d534d7380fb44cbf991377c => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.723117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.778498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:26.780274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.826821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dce6e-a0de-453f-b4a6-adea775f3185 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.870128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.871285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.871764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.872366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.874029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.874951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.876502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.892082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.892082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.911102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cb6c4-1dec-461a-b34c-385d7099249d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.923704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.951721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.952342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.952717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.953007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.963799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.030983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.032407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.034407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de21e50-4b76-4943-a1c5-f62def0a18b6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.080538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.081809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.082533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.083007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.084829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.087532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.090725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 102/200] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.091988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.149111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 99/201] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:27.154566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.166661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.226543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bea24-4ddd-4ef2-b817-3fbda60b48e2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.249377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd6521-0dac-4fec-bb6c-2312a2829389 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.268127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.268750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.269033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.269372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] PATH_INFO: `/v3/users/215f932ddd4e4ae3a5351f1cd940e76e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.271419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=215f932ddd4e4ae3a5351f1cd940e76e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.272939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.275132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 103/202] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/users/215f932ddd4e4ae3a5351f1cd940e76e => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.280251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.314915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.315549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.315793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.316003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.317499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=bf6046311d534d7380fb44cbf991377c) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:27.317499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.318504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.324335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 100/203] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/role_assignments?user.id=bf6046311d534d7380fb44cbf991377c&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.325139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.405741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.451326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9324c3-9976-4567-8df0-fa64875b9ba8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.455634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6608f20-2257-41ef-9b3c-9ebc53d0144e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.526521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.527154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.527435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.527708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.529945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.529945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.529945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.530197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.531871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.532947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.536127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 104/204] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.546308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.618725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.620653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.640221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.704454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.745997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03731d-454e-43bf-b12a-352fe56ec173 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.747934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 101/205] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:27.749000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.811311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.811927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.812205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.812478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.813202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] RBAC: Adding query filter params (role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=bf6046311d534d7380fb44cbf991377c) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:27.813543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.814993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.828285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 105/206] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/role_assignments?user.id=bf6046311d534d7380fb44cbf991377c&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.926667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68c04-99bf-48ac-b635-40639d021940 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.978762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb4d6-0ad5-4110-822d-e3d267f7f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.979407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb4d6-0ad5-4110-822d-e3d267f7f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.979687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb4d6-0ad5-4110-822d-e3d267f7f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.979962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb4d6-0ad5-4110-822d-e3d267f7f1c3 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.981120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb4d6-0ad5-4110-822d-e3d267f7f1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.982745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb4d6-0ad5-4110-822d-e3d267f7f1c3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.984360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 102/207] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.990264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.114973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593418fc-17a1-4d14-9df8-88e2d848559f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.136975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.160336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.160946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.161225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.161524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.162249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] RBAC: Adding query filter params (role.id=e7d2252b67e04fa9a70eed19733d834c, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051, user.id=215f932ddd4e4ae3a5351f1cd940e76e) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:28.162555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.164074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036de21-13cf-4dd8-ab14-8eca415a51cf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.173836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 106/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/role_assignments?user.id=215f932ddd4e4ae3a5351f1cd940e76e&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=e7d2252b67e04fa9a70eed19733d834c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:28.396986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74331866-946c-44b7-a7c2-cc31e5a04048 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.397340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74331866-946c-44b7-a7c2-cc31e5a04048 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.397585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74331866-946c-44b7-a7c2-cc31e5a04048 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.399785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 103/209] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:28.405372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80377-3ec6-49c3-b6ad-3dc40736eb23 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.405660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80377-3ec6-49c3-b6ad-3dc40736eb23 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.405933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80377-3ec6-49c3-b6ad-3dc40736eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.425282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-45b80377-3ec6-49c3-b6ad-3dc40736eb23 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:28.426501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-45b80377-3ec6-49c3-b6ad-3dc40736eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:28.499778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 107/210] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:28.509067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a67a99-f5dd-4642-b6cc-edd3b5dde68e None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.509403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a67a99-f5dd-4642-b6cc-edd3b5dde68e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.509687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a67a99-f5dd-4642-b6cc-edd3b5dde68e None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.511091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 104/211] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:28.518697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.519150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.519589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.540521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:28.542029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:28.618561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 108/212] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:28.795281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a67a99-f5dd-4642-b6cc-edd3b5dde68e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.844786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.907895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a67a99-f5dd-4642-b6cc-edd3b5dde68e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.915348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.945845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.947077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.947373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.947645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.959865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:28.964947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.965895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:28.966722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 105/213] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.971700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.973620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.037954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec9fa8-2b68-40a5-a657-216ade61c267 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.083450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.084105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.084387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.084659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.086135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.087453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2672906-75aa-4b83-bef3-89496e9c58cb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.087685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.089638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.094577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 109/214] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:29.095738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.135945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.137000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.137518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.137893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.138712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.139107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.140568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.154248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 106/215] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.156673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.230383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddaefb-9934-4fc8-975c-24bae7fed358 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.243136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.269419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.270401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.271150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.271626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.272494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.274315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.283765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8c19-23a2-4b56-a1a1-69d21588ad01 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.301980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 110/216] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:29 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:29.321739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b19ed-deca-493b-8980-2c0c97879887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.322395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b19ed-deca-493b-8980-2c0c97879887 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.322675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b19ed-deca-493b-8980-2c0c97879887 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.322949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b19ed-deca-493b-8980-2c0c97879887 None admin] PATH_INFO: `/v3/users/2c96efa597a141659a751f87c640c74b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.339238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b19ed-deca-493b-8980-2c0c97879887 None admin] RBAC: Authorizing `identity:get_user(user_id=2c96efa597a141659a751f87c640c74b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.340753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b19ed-deca-493b-8980-2c0c97879887 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.342525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 107/217] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/users/2c96efa597a141659a751f87c640c74b => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.351665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.471424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041a525-2e5e-40c2-a073-5ffde60d4f4d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.509079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.509665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.509945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.510221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.547960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.588197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.589723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.628293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fc8f1-c3b1-40f6-9459-34c1055db64d None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.628605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fc8f1-c3b1-40f6-9459-34c1055db64d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.628849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fc8f1-c3b1-40f6-9459-34c1055db64d None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.630235 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 108/218] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:29.636713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.637000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.637312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.664662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:29.666735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:29.687083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.710671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 111/219] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:29.718448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.765045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 109/220] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:29.800473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.837699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a438-63c4-47ff-aa77-5cb2f2a546b2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.874560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4586-c492-40ea-aafa-b2dca553f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.875196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4586-c492-40ea-aafa-b2dca553f51c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.875477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4586-c492-40ea-aafa-b2dca553f51c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.875809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4586-c492-40ea-aafa-b2dca553f51c None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.876997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4586-c492-40ea-aafa-b2dca553f51c None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.878576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4586-c492-40ea-aafa-b2dca553f51c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.880558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 112/221] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.886272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.992582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54a0d-c278-41fa-81c3-833e65e3be65 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.035971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.036510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.036800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.037077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.037853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=2c96efa597a141659a751f87c640c74b) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.038181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.040274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.050030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 110/222] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/role_assignments?user.id=2c96efa597a141659a751f87c640c74b&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=b191ebef2f53453e846b638562cda626 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.076884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51375f82-4df5-4c73-99a3-3d564b2b080e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.077470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51375f82-4df5-4c73-99a3-3d564b2b080e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.077470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51375f82-4df5-4c73-99a3-3d564b2b080e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.079117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 113/223] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:30.082286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.085178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.085770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.086261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.103367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.108821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:30.110474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:30.200593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d3d3-a4fd-48fc-885a-d20eb1268e90 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.221318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 114/224] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:30.238845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.239486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.239766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.240040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.251449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:30.256789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.257672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:30.258554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 111/225] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.265790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.333162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.377778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ea06-fca1-40d3-b9ad-a6e5fdfd4d7a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.422327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.422943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.423226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.423502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.424262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.424566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.425967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.441144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 115/226] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.446416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.528345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.550063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.559396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3086e-c49f-4c42-9e21-12b50735240d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.616566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.617594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.619045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.619528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] PATH_INFO: `/v3/users/bf6046311d534d7380fb44cbf991377c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.621013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] RBAC: Authorizing `identity:get_user(user_id=bf6046311d534d7380fb44cbf991377c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.623874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.627677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 112/227] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/users/bf6046311d534d7380fb44cbf991377c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.634063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.703609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fa31-f533-4a89-8f64-e6c9c363bd36 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.748960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.767020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.768432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.769991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.770898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.803052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:30.813713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.814649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:30.815437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:30.819298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 116/228] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:30.830117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.901059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f358ef-a83a-4ffb-b8fd-dd3d1ab8f8ed None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.940031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5699c-39ab-4983-9c67-a23eb3c79ba7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.978125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.979278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.979871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.980402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.981816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.982329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.983885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.986526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.987601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.988093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.988554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.990585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.993521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.994781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 117/229] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:30.999403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 113/230] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:31.001335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.001958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.035182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.095759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.172797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82821847-5c6a-43a3-8afb-c625442090c1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.203325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb4aa4-ce86-4f0f-94f1-677daf368f10 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.243467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.244466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.244940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.245445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/bf6046311d534d7380fb44cbf991377c/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.247949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4505c484dadf4bf9be6a9beb28a78f22, user_id=bf6046311d534d7380fb44cbf991377c, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.249629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.254678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.255787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.256244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.256745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] PATH_INFO: `/v3/users/bf6046311d534d7380fb44cbf991377c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.258127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] RBAC: Authorizing `identity:get_user(user_id=bf6046311d534d7380fb44cbf991377c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.260587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.262504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 118/231] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:31 2022] GET /identity/v3/users/bf6046311d534d7380fb44cbf991377c => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:31.270496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 114/232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:30 2022] PUT /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/bf6046311d534d7380fb44cbf991377c/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:31.272037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.401225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b543-c08c-48ed-b179-3646e5c99d68 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.419206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.449206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1621-7993-40dd-a1f2-97d8e4d564fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.449809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1621-7993-40dd-a1f2-97d8e4d564fc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.450088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1621-7993-40dd-a1f2-97d8e4d564fc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.450360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1621-7993-40dd-a1f2-97d8e4d564fc None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.451507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1621-7993-40dd-a1f2-97d8e4d564fc None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.452951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1621-7993-40dd-a1f2-97d8e4d564fc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.454940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 119/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:31 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:31.460338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.542049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.578904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725c53-18f2-4e61-b718-b36d1bb4eab4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.613906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8bf96-9a4e-4d58-a3e3-c6103b6a08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.614641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bf96-9a4e-4d58-a3e3-c6103b6a08ac None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.614924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bf96-9a4e-4d58-a3e3-c6103b6a08ac None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.615200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bf96-9a4e-4d58-a3e3-c6103b6a08ac None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/bf6046311d534d7380fb44cbf991377c/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.617505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8bf96-9a4e-4d58-a3e3-c6103b6a08ac None admin] RBAC: Authorizing `identity:create_grant(project_id=4505c484dadf4bf9be6a9beb28a78f22, user_id=bf6046311d534d7380fb44cbf991377c, role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.619704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8bf96-9a4e-4d58-a3e3-c6103b6a08ac None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.650115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 115/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:31 2022] PUT /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/bf6046311d534d7380fb44cbf991377c/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:31.922228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1751fc-266f-46c8-9310-d6ecee94882f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.922588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1751fc-266f-46c8-9310-d6ecee94882f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.922783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1751fc-266f-46c8-9310-d6ecee94882f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.924124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 120/235] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:31.930006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.930814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.931100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.952119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:31.953360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:31.981044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a365f-d371-4b50-8a58-e81f87235ae0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.981378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a365f-d371-4b50-8a58-e81f87235ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.981624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a365f-d371-4b50-8a58-e81f87235ae0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.982972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 121/236] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:31.989151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.989447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.989649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.029970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 116/237] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:32.030476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:32.031452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:32.125191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:32.418027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.458483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.486821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.545294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84295f6-eeaf-47cf-afd1-65295598d614 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.591194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.591898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.592119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.592436 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.597068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.598836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.609592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 117/239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:32.624064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.659713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8876250-2fe8-4584-b9ea-b1f991937f62 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.676631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.701599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7efba-1d5e-48ee-9fcd-16d89f048343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.702430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7efba-1d5e-48ee-9fcd-16d89f048343 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.702827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7efba-1d5e-48ee-9fcd-16d89f048343 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.703169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7efba-1d5e-48ee-9fcd-16d89f048343 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.714167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7efba-1d5e-48ee-9fcd-16d89f048343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fea7efba-1d5e-48ee-9fcd-16d89f048343 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:32.719306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:32.720338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:32.721146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:32.721801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 123/240] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:32.723490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54757cf-7e1d-4e35-825b-0d4299c07b8a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.723490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54757cf-7e1d-4e35-825b-0d4299c07b8a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.723490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54757cf-7e1d-4e35-825b-0d4299c07b8a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.724639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 124/241] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:32.729471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54757cf-7e1d-4e35-825b-0d4299c07b8a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.755497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fec58-628f-4386-a4e9-c456992a2a60 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.793001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.802058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902c261-e9e1-4c53-b4f7-b0475f4128bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.802666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902c261-e9e1-4c53-b4f7-b0475f4128bb None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.802944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902c261-e9e1-4c53-b4f7-b0475f4128bb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.803215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902c261-e9e1-4c53-b4f7-b0475f4128bb None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.803876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902c261-e9e1-4c53-b4f7-b0475f4128bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.806676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902c261-e9e1-4c53-b4f7-b0475f4128bb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.845530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 118/242] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:32 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:44:32.847048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.847367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.847691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.870354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54757cf-7e1d-4e35-825b-0d4299c07b8a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.881102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:32.882446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:32.916113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.916998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.917506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.917925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.918858 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:32.919316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.920959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.933190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 125/243] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:32.938513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.984112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.069984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930276-282f-4f0c-b4ed-cca34e66d7bd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.077288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:33.112697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.113274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.113558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.113828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] PATH_INFO: `/v3/users/4b1cda8cf34e453c800b20f108555600` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.128335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] RBAC: Authorizing `identity:get_user(user_id=4b1cda8cf34e453c800b20f108555600)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.129825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.131921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 126/245] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/users/4b1cda8cf34e453c800b20f108555600 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:33.137840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.247507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4916a1-1ae3-4ff6-bb6b-5f505319ebe9 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.264878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.289554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.290211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.290486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.290758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.378995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.380439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.390425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.503261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.511756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be7ec-bba8-4b8f-bf07-df0140e936d5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.512077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 120/246] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:33.518076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.540411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.561679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9f23b-bea5-4bba-a227-efade1e43679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.562331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9f23b-bea5-4bba-a227-efade1e43679 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.562610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9f23b-bea5-4bba-a227-efade1e43679 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.562881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9f23b-bea5-4bba-a227-efade1e43679 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.576883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9f23b-bea5-4bba-a227-efade1e43679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e9d9f23b-bea5-4bba-a227-efade1e43679 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:33.581986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:33.582944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:33.583733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 127/247] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:33.584384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1689-578f-4465-adbe-d1ef0733f3ae None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.584935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1689-578f-4465-adbe-d1ef0733f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.584935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1689-578f-4465-adbe-d1ef0733f3ae None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.586495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 128/248] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:33.591679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.591974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.592263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.611989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:33.613194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:33.654163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2eb15-9c59-4ef0-b0c9-8e24ef037ac2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.704961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 129/249] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:33.706327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.706980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.707255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.707524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.708672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.709985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.710414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.717968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 121/250] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:33.720149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.837780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.855164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d8d0-8bc3-4b4a-950c-7ce5029a1642 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.877618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.907294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf3de-fca9-4e83-8449-bb129c180d74 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.923819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.924442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.924722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.924994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.925755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] RBAC: Adding query filter params (role.id=e7d2252b67e04fa9a70eed19733d834c, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=4b1cda8cf34e453c800b20f108555600) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:33.926061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.927512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.944874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 122/251] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/role_assignments?user.id=4b1cda8cf34e453c800b20f108555600&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=e7d2252b67e04fa9a70eed19733d834c => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:33.980226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.980848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.981135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.981477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.982156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:33.982460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.983934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.998108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 130/252] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.003653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.117710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.143310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7ce76-e251-4910-b366-f4b4a8109e6b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.212234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffe26-3fb2-4c21-9b60-dffa3f48d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.212874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffe26-3fb2-4c21-9b60-dffa3f48d037 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.213153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffe26-3fb2-4c21-9b60-dffa3f48d037 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.214172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffe26-3fb2-4c21-9b60-dffa3f48d037 None admin] PATH_INFO: `/v3/users/2c96efa597a141659a751f87c640c74b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.215446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ffe26-3fb2-4c21-9b60-dffa3f48d037 None admin] RBAC: Authorizing `identity:get_user(user_id=2c96efa597a141659a751f87c640c74b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.216908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ffe26-3fb2-4c21-9b60-dffa3f48d037 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.218878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 123/253] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/users/2c96efa597a141659a751f87c640c74b => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.220037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcba2c-6e38-4dbe-b003-e93077ba7b4d None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.220322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcba2c-6e38-4dbe-b003-e93077ba7b4d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.220705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcba2c-6e38-4dbe-b003-e93077ba7b4d None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.221893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 124/254] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:34.227219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcba2c-6e38-4dbe-b003-e93077ba7b4d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.260951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.296541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b755b-050d-4502-b6a3-de1852d239ac None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.338933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f7fc-e71d-4b53-97d4-4cab48326fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.340015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f7fc-e71d-4b53-97d4-4cab48326fdc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.340626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f7fc-e71d-4b53-97d4-4cab48326fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.341100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f7fc-e71d-4b53-97d4-4cab48326fdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.354225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f7fc-e71d-4b53-97d4-4cab48326fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2013f7fc-e71d-4b53-97d4-4cab48326fdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:34.359761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:34.360661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:34.361517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:34.369334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 131/255] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:34.370865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.371353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.371831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.386370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.399756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:34.400969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:34.432193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcba2c-6e38-4dbe-b003-e93077ba7b4d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.493857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.494905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.495403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.495875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.497583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.500359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.507399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 125/256] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:34.508880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.529169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 132/257] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:34.534179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.689486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241e12f-d0f5-4ab1-93b1-c1a34f38e059 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.737655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.752662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e491a9e-c8d5-49de-9a84-80057dd6353a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.755836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.756802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.757331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.757807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/2c96efa597a141659a751f87c640c74b/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.762544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] RBAC: Authorizing `identity:create_grant(project_id=4505c484dadf4bf9be6a9beb28a78f22, user_id=2c96efa597a141659a751f87c640c74b, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.764307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.767894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.796606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 133/258] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:34 2022] PUT /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/2c96efa597a141659a751f87c640c74b/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:34.839067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.839713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.839990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.840259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.840942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:34.841243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.842693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.861061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 126/259] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.866719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.991320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ac1aa-367a-4bb1-9012-ffa8e8d62ceb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.031712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.032742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.033222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.033710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] PATH_INFO: `/v3/users/bf6046311d534d7380fb44cbf991377c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.035210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] RBAC: Authorizing `identity:get_user(user_id=bf6046311d534d7380fb44cbf991377c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.036919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.039058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 134/260] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/users/bf6046311d534d7380fb44cbf991377c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:35.044620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.052094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.125767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.169962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd532e6-304d-432b-8192-d216708466cb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.215287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.216358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.216837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.217328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.229197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:35.235148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:35.236118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:35.236950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:35.239749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 135/261] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:35.246095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.377312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201acf-da89-489d-9ef7-af1d16677499 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.386954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a062-d6bf-44ef-9442-816fa0150d6a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.447192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.464293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.464293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.464293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.464293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.470954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.471839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.472329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.472798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.473711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:35.476064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.477739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.513294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 136/262] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:35.516448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.537632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.720264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b6d21-dc6b-4f2f-ae02-cd71fa7cc694 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.803819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.806514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.822254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.822916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.823202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.823472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] PATH_INFO: `/v3/users/bf6046311d534d7380fb44cbf991377c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.828037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] RBAC: Authorizing `identity:get_user(user_id=bf6046311d534d7380fb44cbf991377c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.828037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.828037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 137/263] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/users/bf6046311d534d7380fb44cbf991377c => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:35.837509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.970547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 127/264] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:35.984410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.023098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.080514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.110585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8663-95dc-457d-8ec4-214addd819f4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.177274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63da7a-d4d0-4a5d-b2c0-ba263e993757 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.214820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31d586-a098-4609-ae8e-6d8221e9b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.215465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31d586-a098-4609-ae8e-6d8221e9b63f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.215752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31d586-a098-4609-ae8e-6d8221e9b63f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.216030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31d586-a098-4609-ae8e-6d8221e9b63f None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.217154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31d586-a098-4609-ae8e-6d8221e9b63f None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.218838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31d586-a098-4609-ae8e-6d8221e9b63f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.220849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 128/265] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.222444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971707-26d2-49d5-8a2f-1175a419cdf9 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.222747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971707-26d2-49d5-8a2f-1175a419cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.223122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971707-26d2-49d5-8a2f-1175a419cdf9 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.223615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.224236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.224404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 129/266] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:36.224786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.225066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.225445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c91529-0a76-44c0-8859-6fd102438880 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.225717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c91529-0a76-44c0-8859-6fd102438880 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.225995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c91529-0a76-44c0-8859-6fd102438880 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.227513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 130/267] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:36.233558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b79ecc-dd0b-4ba7-b18a-4beba4295409 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.233857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b79ecc-dd0b-4ba7-b18a-4beba4295409 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.234138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b79ecc-dd0b-4ba7-b18a-4beba4295409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.252173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-85b79ecc-dd0b-4ba7-b18a-4beba4295409 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:36.253401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-85b79ecc-dd0b-4ba7-b18a-4beba4295409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:36.302081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.303693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.341525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 131/268] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:36.342685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3a656-9ae0-4267-b701-1fa542264b38 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.342975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3a656-9ae0-4267-b701-1fa542264b38 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.343251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3a656-9ae0-4267-b701-1fa542264b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.365822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a7d3a656-9ae0-4267-b701-1fa542264b38 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:36.367526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a7d3a656-9ae0-4267-b701-1fa542264b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:36.376868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.427275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.449392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 138/269] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:36.450446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.466586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 132/270] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:36.468694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fd143-e55b-42b3-bf24-7a19c375fe41 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.469162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fd143-e55b-42b3-bf24-7a19c375fe41 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.469604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fd143-e55b-42b3-bf24-7a19c375fe41 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.471097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 133/271] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:36.472029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fd143-e55b-42b3-bf24-7a19c375fe41 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.595141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fd143-e55b-42b3-bf24-7a19c375fe41 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.638285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731d67-20d4-446e-b73e-1a4c8556372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.639200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731d67-20d4-446e-b73e-1a4c8556372b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.640035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731d67-20d4-446e-b73e-1a4c8556372b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.640504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731d67-20d4-446e-b73e-1a4c8556372b None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.641876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731d67-20d4-446e-b73e-1a4c8556372b None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.644045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731d67-20d4-446e-b73e-1a4c8556372b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.646361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 134/272] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.647999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.648501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.649738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.667106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4831-3c80-4a46-806d-f02eee28ab97 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.672315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:36.673738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:36.703938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.704577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.704854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.705174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.706027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=bf6046311d534d7380fb44cbf991377c) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:36.706254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.707819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.721361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 139/273] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/role_assignments?user.id=bf6046311d534d7380fb44cbf991377c&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.721361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.732944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.741450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.799267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 135/274] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:36.800553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.835271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ebd8-7ac1-4ad8-8db4-660eff8c37c8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.875531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.876207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.876481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.876797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.877652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] RBAC: Adding query filter params (role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=bf6046311d534d7380fb44cbf991377c) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:36.877971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.879428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.886354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 140/275] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/role_assignments?user.id=bf6046311d534d7380fb44cbf991377c&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.887242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.969165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee068-21bb-46d2-9b52-bc719ee51e04 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.990718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.014374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98552e-638f-4fc9-9dc2-5365f0a85855 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.015109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.015844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.016201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.016663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.020448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.022280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.024911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 136/276] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.031193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.065813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.067621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.071433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.071886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.095882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:37.111280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.112425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:37.113517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:37.115597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 141/277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.118725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.122244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.200774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24de24e-56f6-4c44-a9fc-c294b86ebfd7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.236772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.237651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.238070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.238478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.240006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.241699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.252763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de32b34-7ab4-436f-93c3-796456ed4f13 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.269076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 137/278] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:37 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:44:37.270344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.298283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.298912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.299194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.299543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.300232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.300540 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.302709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.321505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 142/279] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.325314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.330450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.412615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.425160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f694df-29d9-420c-bf7a-88b350ecac6f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.465230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.466022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.466297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.466575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.478066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bd168-0ebf-4716-86c4-8ba77673e4cb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.478520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:37.484485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.485574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:37.486390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:37.489082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 138/280] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.495273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.523085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.523834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.524847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.525873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] PATH_INFO: `/v3/users/5d80952ab97f4471ace64d72bd3e88bc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.542307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] RBAC: Authorizing `identity:get_user(user_id=5d80952ab97f4471ace64d72bd3e88bc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.544057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.546258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 143/281] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/users/5d80952ab97f4471ace64d72bd3e88bc => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.552166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.614719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f323b-aa06-427b-8246-3c15cdc106cd None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.630371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.662745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.663354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.663629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.663898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.665072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.665435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.666826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.677813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 139/282] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.684580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.692040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aa56b-1a57-4f96-b241-8538cefe31db None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.710064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.739299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.740263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.740748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.741244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.742208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, user.id=5d80952ab97f4471ace64d72bd3e88bc, scope.system=all) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.743341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.745085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b007e7-76d6-43cf-8232-ee359ab1cb57 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.750927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 144/283] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/role_assignments?user.id=5d80952ab97f4471ace64d72bd3e88bc&scope.system=all&role.id=b191ebef2f53453e846b638562cda626 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:37.752440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393808-3407-48e5-baa6-12a64238982a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.752931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393808-3407-48e5-baa6-12a64238982a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.753438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393808-3407-48e5-baa6-12a64238982a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.755242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 145/284] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:37.764620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.765254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.765909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.792333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:37.794644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:37.812445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0966e1-6779-480d-a910-a4df743617af None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.854993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.856047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.856531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.857009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] PATH_INFO: `/v3/users/4b1cda8cf34e453c800b20f108555600` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.858466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=4b1cda8cf34e453c800b20f108555600)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.860366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.862629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 140/285] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/users/4b1cda8cf34e453c800b20f108555600 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.870974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.898518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 146/286] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:38.006176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.022763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1951a9-041e-4323-a632-42f1ddea0ad8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.059380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.060019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.060294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.060563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.061703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.063134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.065059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 141/287] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:38.070631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.140061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.187009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e0e82-7fe3-4aaa-a3bb-ef3d475db7f8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.228317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.228984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.229271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.229544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/4b1cda8cf34e453c800b20f108555600/roles/e7d2252b67e04fa9a70eed19733d834c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.234540 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] RBAC: Authorizing `identity:create_grant(project_id=4505c484dadf4bf9be6a9beb28a78f22, user_id=4b1cda8cf34e453c800b20f108555600, role_id=e7d2252b67e04fa9a70eed19733d834c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.235975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.253673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 147/288] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:38 2022] PUT /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/users/4b1cda8cf34e453c800b20f108555600/roles/e7d2252b67e04fa9a70eed19733d834c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:38.354002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.483109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402a01f-37db-40e6-a519-487ad8532ed9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.519443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.520085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.520364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.520639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.531520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:38.536767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:38.537663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:38.538482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 142/289] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:38.545196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.658270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860b6eb-8891-4671-a9e2-f51dd9d33875 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.683493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.713202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.713846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.714130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.714400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.715066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.715367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.716808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.731128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 148/290] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:38.736803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.759852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.873270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2c29b-208c-4d89-a712-520671aca19f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.915106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.915749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.916023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.916293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] PATH_INFO: `/v3/users/2c96efa597a141659a751f87c640c74b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.917450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] RBAC: Authorizing `identity:get_user(user_id=2c96efa597a141659a751f87c640c74b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.918879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.920546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 143/291] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/users/2c96efa597a141659a751f87c640c74b => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.926583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.057725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d164-ef40-4ddb-94f7-f316a53775d8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.093905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.094890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.095384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.095869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.158388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.181692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.183416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.316017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 149/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:39.321923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.440130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.466908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8175a6-2b9a-4e88-b100-ed2acaa9443d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.515543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c860-1802-4fbd-9ca0-c8fc7babf69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.516269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c860-1802-4fbd-9ca0-c8fc7babf69f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.516461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c860-1802-4fbd-9ca0-c8fc7babf69f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.516745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c860-1802-4fbd-9ca0-c8fc7babf69f None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.517886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c860-1802-4fbd-9ca0-c8fc7babf69f None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.519331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c860-1802-4fbd-9ca0-c8fc7babf69f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.525376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 144/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:39.530352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.642449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.672869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91303bb-8f04-4df8-8861-cbce3db17b84 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.722338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.722873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.723155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.723431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.724164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=2c96efa597a141659a751f87c640c74b) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:39.724470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.725929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4fbb9-91d9-440d-b0b1-25f77a4c681a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.732295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 150/294] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/role_assignments?user.id=2c96efa597a141659a751f87c640c74b&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=b191ebef2f53453e846b638562cda626 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:39.845468 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47227cb-1df2-488f-b265-ed17117c50b9 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.845788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47227cb-1df2-488f-b265-ed17117c50b9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.846041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47227cb-1df2-488f-b265-ed17117c50b9 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.847397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 145/295] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:39.853808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc216c-1adb-41a1-b693-0765ce6a879c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.854094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc216c-1adb-41a1-b693-0765ce6a879c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.854353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc216c-1adb-41a1-b693-0765ce6a879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.882986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-88bc216c-1adb-41a1-b693-0765ce6a879c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:39.884293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-88bc216c-1adb-41a1-b693-0765ce6a879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:39.978152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 151/296] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:40.205796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b516df6-fabb-45f5-9d1d-3fd30370d7ce None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.206177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b516df6-fabb-45f5-9d1d-3fd30370d7ce None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.206346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b516df6-fabb-45f5-9d1d-3fd30370d7ce None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.207669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 146/297] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:40.213808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b471be-f88d-4e13-a80b-6ff25f7d108a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.214363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b471be-f88d-4e13-a80b-6ff25f7d108a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.214857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b471be-f88d-4e13-a80b-6ff25f7d108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.236881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-37b471be-f88d-4e13-a80b-6ff25f7d108a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:40.238455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-37b471be-f88d-4e13-a80b-6ff25f7d108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:40.260512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eede5-fb19-427b-8356-fcdbcb3df4b3 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.261122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eede5-fb19-427b-8356-fcdbcb3df4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.261662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eede5-fb19-427b-8356-fcdbcb3df4b3 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.263241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 147/298] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:40.266195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5eede5-fb19-427b-8356-fcdbcb3df4b3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.315724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 152/299] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:40.317598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.317885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.318154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.337444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.350943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:40.352688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:40.391363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5eede5-fb19-427b-8356-fcdbcb3df4b3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.424926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:40.434221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94af8c-b7a7-4b1c-a72d-2f3d7c88a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.435145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94af8c-b7a7-4b1c-a72d-2f3d7c88a121 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.435733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94af8c-b7a7-4b1c-a72d-2f3d7c88a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.436384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94af8c-b7a7-4b1c-a72d-2f3d7c88a121 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.447716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94af8c-b7a7-4b1c-a72d-2f3d7c88a121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-4e94af8c-b7a7-4b1c-a72d-2f3d7c88a121 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:40.452797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:40.453731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:40.454523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:40.457012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 148/301] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:40.463183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.565407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773742a6-6d9c-40a5-a0dc-244af956444e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.596342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.601198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.605957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.606477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.606941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.607818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:40.608312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.609895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.610617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36f1f-18eb-41de-b3e9-896561305a04 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.611041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36f1f-18eb-41de-b3e9-896561305a04 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.611195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36f1f-18eb-41de-b3e9-896561305a04 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.612510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 149/302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:40.617744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.618271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.618666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.620766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 154/303] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:40.626914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.640970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:40.642231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:40.645461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.713721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 150/304] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:40.714564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.741101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee277ff-0062-4879-8d67-7b659741fa4b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.777681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.778311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.778596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.778875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] PATH_INFO: `/v3/users/0337c9d906aa47bcbadcdfe412c80f0b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.792076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] RBAC: Authorizing `identity:get_user(user_id=0337c9d906aa47bcbadcdfe412c80f0b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.793564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.795191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 155/305] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/users/0337c9d906aa47bcbadcdfe412c80f0b => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:40.795950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.823676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b800a92-758a-4fb9-b7ad-917733cac3aa None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.851544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.859256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.859893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.860170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.860439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.861552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.862977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.869570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 151/306] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:40.869570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.881336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.909522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94a2c-71cd-4560-8eb7-e838de504305 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.944713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.945369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.945646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.945949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.956363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:40.961200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:40.962860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 156/307] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:40.966176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.981445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70d463-7db9-4fdc-9a39-12d7a96f3816 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.014447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.015053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.015337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.015662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.016378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] RBAC: Adding query filter params (role.id=e7d2252b67e04fa9a70eed19733d834c, user.id=0337c9d906aa47bcbadcdfe412c80f0b, scope.system=all) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.016686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.018153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.023199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 152/308] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/role_assignments?user.id=0337c9d906aa47bcbadcdfe412c80f0b&scope.system=all&role.id=e7d2252b67e04fa9a70eed19733d834c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.026145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.074941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276ded-3d32-4a92-9a33-2f9f6ef1c084 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.089153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.109014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.115420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.116047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.116326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.116637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] PATH_INFO: `/v3/groups` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.117215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.119289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.136432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 157/309] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:41.141418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.150869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d9cf-6837-43a6-9cff-30879133fbaf None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.194958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.196223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.196509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.196783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.197504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.199289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.199979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.217325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 153/310] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.217325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.277927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee117d-c4e0-4579-9634-0419478e1409 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.325296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.325988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.326271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.326550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.342553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:41.349023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:41.349998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:41.350816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 158/311] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:41.351674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee36b6-f589-4f39-b183-34b6593be6e0 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.358223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.395636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.396589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.396874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.397147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] PATH_INFO: `/v3/users/5d80952ab97f4471ace64d72bd3e88bc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.398962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] RBAC: Authorizing `identity:get_user(user_id=5d80952ab97f4471ace64d72bd3e88bc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.401196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.404234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 154/312] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/users/5d80952ab97f4471ace64d72bd3e88bc => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:41.404679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.410054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.413507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.475534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5557a-6577-4035-8cc3-cf1105bc1d2b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.513726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.514160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb93fa-8e40-47df-948b-5b2892d81974 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.514492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.514842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.515193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.516032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.516507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.517989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.528315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 159/313] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.533521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.554642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.555840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.556125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.556396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] PATH_INFO: `/v3/system/users/5d80952ab97f4471ace64d72bd3e88bc/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.557846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5d80952ab97f4471ace64d72bd3e88bc, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.559216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.570017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 155/314] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 24 07:44:41 2022] PUT /identity/v3/system/users/5d80952ab97f4471ace64d72bd3e88bc/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:41.653466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d719b-7194-4842-b3b0-ce2b3711b0e3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.657734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.693697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.694353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.694637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.694905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] PATH_INFO: `/v3/users/4b1cda8cf34e453c800b20f108555600` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.696738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] RBAC: Authorizing `identity:get_user(user_id=4b1cda8cf34e453c800b20f108555600)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.698236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.700430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 160/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/users/4b1cda8cf34e453c800b20f108555600 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:41.705905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.776041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.814096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815e473-d879-4a5b-a942-bf133fb1336c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.848159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.848775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.849058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.849363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.921603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.923268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.990862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:42.028651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 156/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:42.034197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:42.140361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d329753-151e-498e-a255-906cd939ec3d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:42.176113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040132-05ff-4709-ad7e-b770bab3d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:42.176675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040132-05ff-4709-ad7e-b770bab3d173 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.176955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040132-05ff-4709-ad7e-b770bab3d173 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.177228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040132-05ff-4709-ad7e-b770bab3d173 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.178372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040132-05ff-4709-ad7e-b770bab3d173 None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:42.179807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040132-05ff-4709-ad7e-b770bab3d173 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:42.182325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 161/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:42 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:42.188548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:42.293195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6e6d-f6a3-4d50-917f-3a58e85e005e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:42.328164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:42.328767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.329050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.329354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.330072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] RBAC: Adding query filter params (role.id=e7d2252b67e04fa9a70eed19733d834c, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22, user.id=4b1cda8cf34e453c800b20f108555600) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:42.330382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:42.331940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84994-871e-4990-addd-8d3f12ed690c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:42.339874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 157/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:42 2022] GET /identity/v3/role_assignments?user.id=4b1cda8cf34e453c800b20f108555600&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=e7d2252b67e04fa9a70eed19733d834c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:42.955186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843147-5dce-42e3-8ca9-3933795cb8a1 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.955566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843147-5dce-42e3-8ca9-3933795cb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.955742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843147-5dce-42e3-8ca9-3933795cb8a1 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.957200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 162/319] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:42.962181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c136-db06-4584-9929-37fc02ac159c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.962612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c136-db06-4584-9929-37fc02ac159c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.962789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c136-db06-4584-9929-37fc02ac159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.981151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0653c136-db06-4584-9929-37fc02ac159c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:42.982358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0653c136-db06-4584-9929-37fc02ac159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:43.006968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.050803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 158/320] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:43.195000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2fe55-62d3-4e08-9b04-ad3a7032105b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.195508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2fe55-62d3-4e08-9b04-ad3a7032105b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.195591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2fe55-62d3-4e08-9b04-ad3a7032105b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.197021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 163/321] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:43.202101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.202387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.202657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.220726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:43.221834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:43.287227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 159/322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:43.318916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2fe55-62d3-4e08-9b04-ad3a7032105b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.354264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.429049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2fe55-62d3-4e08-9b04-ad3a7032105b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.464082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.464714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.464995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.465288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.475435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:43.480696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:43.481576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:43.486175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 164/323] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:43.489863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.552092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.584844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.595730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d30a1-52d1-408b-ac3e-f44f1e5de701 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.629077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.629720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.629997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.630277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.630924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:43.631224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.632594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1285c4-d106-414a-b2aa-75cbf3301f08 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.640969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 160/324] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:43.642135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9fac-a7ed-4728-a335-468d7e73d625 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.642407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9fac-a7ed-4728-a335-468d7e73d625 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.642687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9fac-a7ed-4728-a335-468d7e73d625 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.643558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.645380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 161/325] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:43.647505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9fac-a7ed-4728-a335-468d7e73d625 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.654952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d4ccb-26d6-4272-add7-c179fc684df0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.690585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca2796-60c5-458e-a54d-09e4862c727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.691210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca2796-60c5-458e-a54d-09e4862c727d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.691490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca2796-60c5-458e-a54d-09e4862c727d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.691760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca2796-60c5-458e-a54d-09e4862c727d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.692847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca2796-60c5-458e-a54d-09e4862c727d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.694309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca2796-60c5-458e-a54d-09e4862c727d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.696412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 165/326] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:43.697519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.697800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.698073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.714986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:43.716184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:43.753192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9fac-a7ed-4728-a335-468d7e73d625 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.797283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:43.797283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.797561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.797561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.797561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.797561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] PATH_INFO: `/v3/users/0337c9d906aa47bcbadcdfe412c80f0b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.797823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] RBAC: Authorizing `identity:get_user(user_id=0337c9d906aa47bcbadcdfe412c80f0b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.797823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.797823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 162/328] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/users/0337c9d906aa47bcbadcdfe412c80f0b => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:43.801355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.822143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.878002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.893380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2b185-b555-4c29-8f9d-a8751c2004b2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.908363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702a4d-de8f-421b-ba61-8b2e2dffd908 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.930861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.931633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.931913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.932240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] PATH_INFO: `/v3/groups` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.932852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.934538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.941857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.942535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.942789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.943068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] PATH_INFO: `/v3/system/users/0337c9d906aa47bcbadcdfe412c80f0b/roles/e7d2252b67e04fa9a70eed19733d834c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.944472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0337c9d906aa47bcbadcdfe412c80f0b, role_id=e7d2252b67e04fa9a70eed19733d834c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.945961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.950061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 167/329] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 24 07:44:43 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:43.957360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 163/330] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 24 07:44:43 2022] PUT /identity/v3/system/users/0337c9d906aa47bcbadcdfe412c80f0b/roles/e7d2252b67e04fa9a70eed19733d834c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:44.054212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.161787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d285-a6c3-4db9-98df-2573a0af1816 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.196586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.197328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.197589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.197801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.209343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:44.214651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:44.215565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:44.216363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 168/331] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:44.223180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.322954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.354184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e666ce-e500-42a6-a7fc-06926101e405 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.390582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.391202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.391486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.391762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.392428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:44.392732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.394393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.404065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 164/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:44.409211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.423072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.521071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e1fb0-493e-467f-856e-f618ef8d8618 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.557090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89fb7a-ebc2-46cb-9712-a29f1a7516ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.557747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89fb7a-ebc2-46cb-9712-a29f1a7516ae None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.558024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89fb7a-ebc2-46cb-9712-a29f1a7516ae None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.558292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89fb7a-ebc2-46cb-9712-a29f1a7516ae None admin] PATH_INFO: `/v3/users/5d80952ab97f4471ace64d72bd3e88bc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.559412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89fb7a-ebc2-46cb-9712-a29f1a7516ae None admin] RBAC: Authorizing `identity:get_user(user_id=5d80952ab97f4471ace64d72bd3e88bc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.560847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89fb7a-ebc2-46cb-9712-a29f1a7516ae None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.562751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 169/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/users/5d80952ab97f4471ace64d72bd3e88bc => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:44.568580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.683152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885e83-33c5-462c-93fd-d558ea79d472 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.722392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.722998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.723280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.723548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.724329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] RBAC: Adding query filter params (role.id=b191ebef2f53453e846b638562cda626, user.id=5d80952ab97f4471ace64d72bd3e88bc, scope.system=all) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:44.724636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.726080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37881ddd-2014-4b71-bada-152ecc085fa8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.739438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 165/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/role_assignments?user.id=5d80952ab97f4471ace64d72bd3e88bc&scope.system=all&role.id=b191ebef2f53453e846b638562cda626 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:46.057598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e2e0-0eb2-4bc1-9788-2c35717a59dc None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.058596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e2e0-0eb2-4bc1-9788-2c35717a59dc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.059108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e2e0-0eb2-4bc1-9788-2c35717a59dc None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.060960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 170/335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:46.067089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e9de-f893-4905-af00-d46286161576 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.067924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e9de-f893-4905-af00-d46286161576 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.068422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e9de-f893-4905-af00-d46286161576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.078367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.092448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-3358e9de-f893-4905-af00-d46286161576 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:46.093951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3358e9de-f893-4905-af00-d46286161576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:46.181694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 166/336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:46.213148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5a667-7759-4fdc-b9f1-09cf4c5b5204 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.213811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5a667-7759-4fdc-b9f1-09cf4c5b5204 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.214319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5a667-7759-4fdc-b9f1-09cf4c5b5204 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.216255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 171/337] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:46.233655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9418ae-10c4-4022-8967-95927c06bb8a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.234262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9418ae-10c4-4022-8967-95927c06bb8a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.234737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9418ae-10c4-4022-8967-95927c06bb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.254300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ee9418ae-10c4-4022-8967-95927c06bb8a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:46.255832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ee9418ae-10c4-4022-8967-95927c06bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:46.330314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:46.408033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485844bc-0bdc-4b15-bb94-312ccce0f96e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.408703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485844bc-0bdc-4b15-bb94-312ccce0f96e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.409219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485844bc-0bdc-4b15-bb94-312ccce0f96e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.410778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 172/339] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:46.416318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.416872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.417388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.439063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:46.440562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:46.510208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.520167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 168/340] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:46.718702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485844bc-0bdc-4b15-bb94-312ccce0f96e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.759400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.817676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.840870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485844bc-0bdc-4b15-bb94-312ccce0f96e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.884240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.885488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.885916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.886357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.906713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:46.912009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:46.913090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:46.914130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:46.921374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 173/341] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:46.923315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.009859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde14b09-5f0b-4777-8e1f-d3d9dc65b50c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.074008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.074697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.074933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.075205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.089555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:47.094292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:47.095175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:44:47.095953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:47.097046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 169/342] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:47.097046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.099767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922d40-9584-4ed8-a7b1-324b37fbc6c0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.163922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.164560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.164835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.165111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.165786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:47.166085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.167449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.181590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.191212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 174/343] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:47.192035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.216876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.291173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a234-8715-4f5f-b8d6-ada13dc2f8e4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.329895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.330536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.330822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.331240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.343216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:47.349516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:47.350466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 170/344] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:47.351278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.365464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640d0ac-30eb-4cf4-8a6f-71e06b57a74a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.433867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.434491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.434772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.435046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.435714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:47.436015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.437436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.454826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 175/345] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:47.455661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.466679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01722a-57c7-41de-b46c-a5b132e72d1c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.485705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.502977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.503589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.503867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.504170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.531916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.578025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.579412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.589270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0187d0e-d488-48c7-b787-49369f01c937 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.691710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.692856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.692856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.693133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.694584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:47.694584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.695730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832f52-adee-46d3-b71d-38e47c852979 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.698206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 171/346] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:47.699451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.706927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 176/347] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:47.708149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee61c-14ff-4e7c-a711-d11e399f64d6 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.708432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee61c-14ff-4e7c-a711-d11e399f64d6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.708703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee61c-14ff-4e7c-a711-d11e399f64d6 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.719033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 177/348] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:47.719033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ee61c-14ff-4e7c-a711-d11e399f64d6 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.727102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.826155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1cc8e-776c-4948-98d0-b59f74ea8a3b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.859445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ee61c-14ff-4e7c-a711-d11e399f64d6 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.869189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.870138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.870694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.871185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] PATH_INFO: `/v3/users/0337c9d906aa47bcbadcdfe412c80f0b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.872544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] RBAC: Authorizing `identity:get_user(user_id=0337c9d906aa47bcbadcdfe412c80f0b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.874583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.876441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 172/349] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/users/0337c9d906aa47bcbadcdfe412c80f0b => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:47.878832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.885590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.901857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae5c4d-0651-41df-847f-c6546fa8b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.902553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c4d-0651-41df-847f-c6546fa8b0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.903084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c4d-0651-41df-847f-c6546fa8b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.903419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c4d-0651-41df-847f-c6546fa8b0e2 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.904942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae5c4d-0651-41df-847f-c6546fa8b0e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.906463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae5c4d-0651-41df-847f-c6546fa8b0e2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.909595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 178/350] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:47.910580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.910864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.911137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.938536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:47.940303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:47.992278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.013147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a89839-9dcb-446f-a174-76bde833f414 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.053410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 179/351] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:48.054329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.077982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce35e0-5b18-4c85-adb4-ba87c6e1ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.078617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce35e0-5b18-4c85-adb4-ba87c6e1ff4d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.078896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce35e0-5b18-4c85-adb4-ba87c6e1ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.079167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce35e0-5b18-4c85-adb4-ba87c6e1ff4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.181861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9f5a7-18ca-4a16-a0fe-5ce7ccaba448 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.207922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.208181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce35e0-5b18-4c85-adb4-ba87c6e1ff4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.210788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce35e0-5b18-4c85-adb4-ba87c6e1ff4d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.226165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.227113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.227595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.228060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.229074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] RBAC: Adding query filter params (role.id=e7d2252b67e04fa9a70eed19733d834c, user.id=0337c9d906aa47bcbadcdfe412c80f0b, scope.system=all) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.229607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.231434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.246014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 180/352] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/role_assignments?user.id=0337c9d906aa47bcbadcdfe412c80f0b&scope.system=all&role.id=e7d2252b67e04fa9a70eed19733d834c => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.247101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.367901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484193-8e51-4cb4-b18d-e24a4c297df6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.370583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.405856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 173/353] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:48.407321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7f8e-50cc-4599-b94a-66bf77f3035e None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.407610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7f8e-50cc-4599-b94a-66bf77f3035e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.407918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7f8e-50cc-4599-b94a-66bf77f3035e None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.409513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 174/354] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:48.411156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf7f8e-50cc-4599-b94a-66bf77f3035e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.414465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.415906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.416383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.416917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.424505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.426347 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.429118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 181/355] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.430282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.482455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.547122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf7f8e-50cc-4599-b94a-66bf77f3035e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.563428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dec1c-b497-42ef-b44b-ce2ce395a655 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.591227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea9df-13cf-46b4-bba8-9c2e8155f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.591905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea9df-13cf-46b4-bba8-9c2e8155f555 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.592138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea9df-13cf-46b4-bba8-9c2e8155f555 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.592411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea9df-13cf-46b4-bba8-9c2e8155f555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.608219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea9df-13cf-46b4-bba8-9c2e8155f555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:48.610465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.611101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.611384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.611658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.612779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-5e0ea9df-13cf-46b4-bba8-9c2e8155f555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:48.612975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:48.614015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:48.614809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:48.615415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.615482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 175/356] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:48.619125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 182/357] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.619267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.619267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.619267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.619467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.636798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:48.637993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:48.679887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.722714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 176/358] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:48.723545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.749114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89631a-c317-4610-ad85-b2a417f69465 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.761164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.801694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.802982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.803469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.804153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.806238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=b191ebef2f53453e846b638562cda626, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.806558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.808007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.817603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 183/359] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=b191ebef2f53453e846b638562cda626 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.817603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.848269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49632c1b-068d-4b0d-b982-e90f3b4bc5dd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.906489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.907477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.907962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.908444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.909411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.909935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.912488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea89e3-f5d4-40f5-9107-b99355103743 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.925016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 177/360] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.926865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d57db-8f44-45be-9e01-bb8b3dce8453 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.927388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d57db-8f44-45be-9e01-bb8b3dce8453 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.927869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d57db-8f44-45be-9e01-bb8b3dce8453 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.931774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 178/361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:48.932936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d57db-8f44-45be-9e01-bb8b3dce8453 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.987003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.000900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa077f0-d98e-494b-93b3-08e656c45e09 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.049444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c033c6e-a850-4fb5-8b22-43df67a6090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.050173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c033c6e-a850-4fb5-8b22-43df67a6090e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.050465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c033c6e-a850-4fb5-8b22-43df67a6090e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.050747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c033c6e-a850-4fb5-8b22-43df67a6090e None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.052209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c033c6e-a850-4fb5-8b22-43df67a6090e None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.053738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c033c6e-a850-4fb5-8b22-43df67a6090e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.055521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 184/362] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.056476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.056759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.057031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.074781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:49.075990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:49.079964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d57db-8f44-45be-9e01-bb8b3dce8453 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.122397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.122747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.123653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.123653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.123942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.167681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 185/363] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:49.168935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.220151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.221634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.257834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.294597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b02b-27e7-4d0a-b125-440fbbc31e5e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.333199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 179/364] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:49.334190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.349959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.350898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.351435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.351962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.364577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:49.370226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:49.371098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:49.371911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:49.374746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 186/365] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:49.375876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.413777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.450372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3696fd-f61f-4155-badf-11fef911f2f9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.490199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.490806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.491137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.491353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.492073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.492377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.493880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.495839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.503437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 180/366] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.503959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.506753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62c99b-f594-498b-9d01-8dbe0612cdbb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.556055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.556744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.557120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.557585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.558797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.560425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.562472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 187/367] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.563445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.640652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1301d-5a64-48c7-b690-668f407465fb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.693796 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.697505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88139e5-61d5-4639-9dd3-b3a2c488e3fd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.699311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.699942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.700222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.700496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.701209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.701544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.702960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.716581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 181/368] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.718176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.750990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.752054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.752584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.752863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.768526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:49.775147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:49.776131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:49.776909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 188/369] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:49.777632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.795225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.843913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6027d-d780-44da-913b-6325f536f376 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.888449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.889506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.889793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.890068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.891395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.894557 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.896688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 182/370] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.897867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.921146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fcfdb-8027-46f5-bfb6-e564084dbf96 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.967389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.968073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.968358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.968687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.000819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.029592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777df3e6-37b8-41d5-982a-a84339af5fb6 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.048022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.049554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.066203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.082934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.083647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.083832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.084223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.084963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:50.085462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.088312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.102040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 183/371] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.102821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.173236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 189/372] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:50.174441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.240214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6862-2308-4f95-9bbf-0fdf2531a1a5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.247340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.289715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.290687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.291187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.291708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.292674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=b191ebef2f53453e846b638562cda626, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:50.293175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.294832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.299088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233324b-17ea-43db-a96a-a7520ab9f10b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.301844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 184/373] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=b191ebef2f53453e846b638562cda626 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.302839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.349795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.350150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.350435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.350707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.386622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.469510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.471171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.491344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc9776-bb99-46f1-aedc-fa3e9f9c98c8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.553233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.593989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.594651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.594939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.595214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.596416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.597909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.599881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 185/374] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.601674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 190/375] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:50.605604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.608835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.791280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d021bd7-7f49-4aab-8d17-76ff83ac0d3e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.821431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.834063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd67051-17bb-4a4a-9f79-62274af31a28 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.853754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.854759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.855242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.855715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.858333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.859995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.861847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 186/376] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:50.868328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.907951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.908969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.909639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.911152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] PATH_INFO: `/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.912573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] RBAC: Authorizing `identity:get_project(project_id=ef5d9282c24b4d00b4d4a768619e22cb)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.914953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.923144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 191/377] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb => generated 344 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.926366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.980760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.067024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a543f5-23bc-4023-b082-a6a8a0f65e7a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.100065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe122b-728b-4ed5-a8db-9892e1e58771 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.114295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.114948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.115188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.115463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.116190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.116502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.117997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f59400-5399-4105-8560-62848a31aed1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.123971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 187/378] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.125129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864b14-0c59-449f-9ef4-dfacafebffc8 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.131297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864b14-0c59-449f-9ef4-dfacafebffc8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.131297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864b14-0c59-449f-9ef4-dfacafebffc8 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.131297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 188/379] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:51.140922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.141220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.141512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.168103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:51.170162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:51.171364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.172014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.172293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.172566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] PATH_INFO: `/v3/groups/96ce4a7685d3466fa23bccce77528364` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.185900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] RBAC: Authorizing `identity:get_group(group_id=96ce4a7685d3466fa23bccce77528364)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.187377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.189222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 192/380] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/groups/96ce4a7685d3466fa23bccce77528364 => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.199333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.291729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.315672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 189/381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:51.361439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.375889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da624a0-c093-40c2-a554-9797b48774e0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.428282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.428888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.429215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.429511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.430314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] RBAC: Adding query filter params (group.id=96ce4a7685d3466fa23bccce77528364, role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=ef5d9282c24b4d00b4d4a768619e22cb) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.430616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.432088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.441439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 193/382] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/role_assignments?group.id=96ce4a7685d3466fa23bccce77528364&scope.project.id=ef5d9282c24b4d00b4d4a768619e22cb&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.653657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.761124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9e4c-0d38-47aa-bb3c-0f30ce1ca7d1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.796910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.797580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.798131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.798402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.808747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:51.813475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:51.814377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:51.815248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 190/383] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:51.821183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.940109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18451e6-0d2d-4508-a6b7-8577a97c7e00 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.978451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.979071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.979352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.979626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.980288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.980587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.981969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7b791-3ec6-4b32-bfec-66d08413997c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.990975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 194/384] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.996270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.010715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f74ed-9890-4dfa-bbeb-4581a4528658 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.011028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f74ed-9890-4dfa-bbeb-4581a4528658 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.011276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f74ed-9890-4dfa-bbeb-4581a4528658 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.014883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 195/385] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:52.020380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.020380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.020380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.037992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:52.039850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:52.063108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.096267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.119741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 196/386] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:52.172904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c11eb-eb4c-40a9-8895-6f865b7e7022 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.217279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.217843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.218125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.218400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.219525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.221277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.223229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 191/387] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:52.228357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.348306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391aa7-173e-4b72-86fe-abe2dd5a1425 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.385554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.386190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.386463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.386737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.387949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.389411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.391396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 197/388] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:52.397152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.463878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.501197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.556070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c969e3-5086-4dc2-86ef-be5ad6b3fc41 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.582020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.622192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.624534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.624963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.626230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/groups/98238d70a14646ad9cac234ab1121cfc/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.629645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a9edcab5a4ec2997ce4702f7f3051, group_id=98238d70a14646ad9cac234ab1121cfc, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.632829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.661177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c3ec0-e92f-41b2-8b4b-5e83cad06ba2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.672683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 192/389] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:52 2022] PUT /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/groups/98238d70a14646ad9cac234ab1121cfc/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:52.707198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8509c23-befb-4bff-b6e9-4197c324872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.707852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8509c23-befb-4bff-b6e9-4197c324872b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.708134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8509c23-befb-4bff-b6e9-4197c324872b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.708411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8509c23-befb-4bff-b6e9-4197c324872b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.721398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8509c23-befb-4bff-b6e9-4197c324872b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e8509c23-befb-4bff-b6e9-4197c324872b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:52.726237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:52.727892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:52.729311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 198/390] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:52.737046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.919589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f0287-2ffe-4383-9975-1271a90669d1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.919769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a04de-3b28-4c2e-aea8-9bc1c4f6d94d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.920014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a04de-3b28-4c2e-aea8-9bc1c4f6d94d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.920294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a04de-3b28-4c2e-aea8-9bc1c4f6d94d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.921942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 199/391] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:52.929583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.930555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.932515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.967721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:52.967721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:52.970342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.971334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.971885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.972416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.973354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:52.973862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.975433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.985415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:52.990726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.053363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.079132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 200/393] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:53.136242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea6dd-cb1e-4bf0-9185-a9dadcd18c51 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.177129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.177772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.178008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.178237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.179350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.181483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.183347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.188915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.201412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.313372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253c65c-cf39-442c-9ff0-3bdf2a83db0d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.354510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.355148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.355418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.355685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.362002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.363548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.365502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 201/395] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.371133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.448886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.521247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4da0-fddc-41d8-b17d-77b7148db4f0 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.523034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.585865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.586725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.587412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.587696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.587971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/groups/98238d70a14646ad9cac234ab1121cfc/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.595938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a9edcab5a4ec2997ce4702f7f3051, group_id=98238d70a14646ad9cac234ab1121cfc, role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.597945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.611803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22a7c4-6fd9-4c41-a01a-8c8b42c3765f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.624774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 195/396] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:53 2022] PUT /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051/groups/98238d70a14646ad9cac234ab1121cfc/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:53.655974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.656665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.656943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.657211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.669221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:53.674897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:53.675848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:53.676730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 202/397] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:53.685283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.814978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da131479-e523-46c6-b2ef-f0aa8ba53449 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.856255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.856886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.857172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.857476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.858167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:53.858474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.859940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b589c-d2da-4c70-8a90-c2ddfba25f36 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.874774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 196/398] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.876187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.000962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b128163-1f49-433e-a901-097861497284 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.001644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b128163-1f49-433e-a901-097861497284 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.002174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b128163-1f49-433e-a901-097861497284 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.005050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 197/399] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:54.006947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29102a97-dac4-4318-80d5-3d614bd36e08 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.012187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaa2ce-586f-45eb-8178-cb60711fa1bb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.012481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaa2ce-586f-45eb-8178-cb60711fa1bb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.012754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaa2ce-586f-45eb-8178-cb60711fa1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.036475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2ecaa2ce-586f-45eb-8178-cb60711fa1bb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:54.038058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2ecaa2ce-586f-45eb-8178-cb60711fa1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:54.043693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.044381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.044662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.044931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.046118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.047601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.053284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 203/400] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:54.055509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.075117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.076343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.142321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 198/401] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:54.144036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9b75-c023-49cd-9fee-e6cff19f8dd9 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.144548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9b75-c023-49cd-9fee-e6cff19f8dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.145063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9b75-c023-49cd-9fee-e6cff19f8dd9 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.146996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 199/402] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:54.157292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.157292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.157292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.194025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:54.195264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:54.219410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd50e5f-6b28-48c0-b9f7-731b2ea32440 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.255923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.256561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.256847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.257120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.258985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.260656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.266626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 204/403] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:54.269384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.356481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 200/404] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:54.373609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.427960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843553-2efd-418e-a362-69e2d72ff1db None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.462182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.482194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.483512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.483990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.484460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/groups/98238d70a14646ad9cac234ab1121cfc/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.488201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] RBAC: Authorizing `identity:create_grant(project_id=4505c484dadf4bf9be6a9beb28a78f22, group_id=98238d70a14646ad9cac234ab1121cfc, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.489875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.514171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 205/405] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:54 2022] PUT /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/groups/98238d70a14646ad9cac234ab1121cfc/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:54.580203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.603086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836f5e3-1287-40ef-8e7a-f76a49af96fc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.664677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.665616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.666046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.666467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.678692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:54.683926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:54.685056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:54.686069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:54.686674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.688250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 201/406] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:54.693565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.817569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899292-97aa-4bc5-9106-f83776ab296d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.834031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b088a76-fbb7-445c-bb87-e679da205272 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.882496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.883880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.884895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.886011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.886140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.886960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:54.888794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.890381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.894621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.895518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.895967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.896645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.908482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 202/407] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:54.913318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.919660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:54.925114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:54.926299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:54.927337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:54.935339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 206/408] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:54.935841 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.941202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.035700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0bfff-5797-44cf-9ad6-5f4ad6b70671 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.072400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80256035-c562-4e02-948c-2b221bf7cecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.073042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80256035-c562-4e02-948c-2b221bf7cecc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.073346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80256035-c562-4e02-948c-2b221bf7cecc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.073621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80256035-c562-4e02-948c-2b221bf7cecc None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.074737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80256035-c562-4e02-948c-2b221bf7cecc None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.076164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80256035-c562-4e02-948c-2b221bf7cecc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.078035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:55.079294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984b99e-5a6a-4ccb-93f0-00e25b020d60 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.079577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984b99e-5a6a-4ccb-93f0-00e25b020d60 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.079849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984b99e-5a6a-4ccb-93f0-00e25b020d60 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.081228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 204/410] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:55.086584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984b99e-5a6a-4ccb-93f0-00e25b020d60 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.107647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea70b3-9bc9-4abe-8855-ac98203415a6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.143603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.144123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.144397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.144674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.145507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:55.145781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.147403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2e4ef-499d-4cfa-8acc-0392001d70ed None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.156593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 207/411] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:55.157914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.158197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.158562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.171199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.181136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:55.182818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:55.200169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984b99e-5a6a-4ccb-93f0-00e25b020d60 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.239437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.240076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.240431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.240762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.241982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.243892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.246377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.248484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:55.249466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.281000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 208/413] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:55.282155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.383354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631581-f31f-42d5-9219-f704e2f3d13b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.421026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.422048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.422526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.422991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] PATH_INFO: `/v3/groups/96ce4a7685d3466fa23bccce77528364` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.426761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] RBAC: Authorizing `identity:get_group(group_id=96ce4a7685d3466fa23bccce77528364)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.428702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.432212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 206/414] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/groups/96ce4a7685d3466fa23bccce77528364 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:55.439347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.471161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.491161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd13e4-3eec-43f7-aa8c-b9d9ebb667b4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.553301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.553974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.554269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.554551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/groups/98238d70a14646ad9cac234ab1121cfc/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.562414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] RBAC: Authorizing `identity:create_grant(project_id=4505c484dadf4bf9be6a9beb28a78f22, group_id=98238d70a14646ad9cac234ab1121cfc, role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.563932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.584473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 209/415] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:55 2022] PUT /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22/groups/98238d70a14646ad9cac234ab1121cfc/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:55.592048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bca68-5b5e-4606-88ab-21e7d2044d71 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.624504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.636555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.637648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.638146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.638677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] PATH_INFO: `/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.640114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] RBAC: Authorizing `identity:get_project(project_id=ef5d9282c24b4d00b4d4a768619e22cb)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.642057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.647553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 207/416] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:55.651073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.744892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.749141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.773078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a67a9-3809-475d-95e1-ffee4c263c4b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.813679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.815112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.815553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.815998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] PATH_INFO: `/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb/groups/96ce4a7685d3466fa23bccce77528364/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.818399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef5d9282c24b4d00b4d4a768619e22cb, group_id=96ce4a7685d3466fa23bccce77528364, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.821170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.841560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 208/417] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:55 2022] PUT /identity/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb/groups/96ce4a7685d3466fa23bccce77528364/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:55.860962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9a91d-ea96-4cb3-acdc-79640b72d268 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.903023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.903741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.904023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.904293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.916898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:55.921925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:55.922906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:55.924146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 210/418] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:55.929291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.047985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4ca8b-274f-4105-8528-506fd0a07d76 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.083637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.084262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.084539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.084813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.085516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:56.085820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.087301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af695959-fe02-40d6-b815-f2ee940dd5ea None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.093019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.102471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 209/419] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:56.107630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.163153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ef4f-3db4-4972-8163-6fe05e12efdb None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.163787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ef4f-3db4-4972-8163-6fe05e12efdb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.164861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ef4f-3db4-4972-8163-6fe05e12efdb None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.166702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 210/420] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:56.174231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.175091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.175589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.198462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:56.201173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:56.264459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7655f8-3421-44a4-a3f2-07509ba5cc77 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.266334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.286957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 211/421] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:56.333254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.334224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.334715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.335199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.460743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.462266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.591423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 211/422] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:56.596851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.665954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.668563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.760430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c103ef-0fab-4bcb-84bc-b00fe6951717 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.812414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.821947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.822585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.822866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.823141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.825841 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.827278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.833622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 212/423] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:56.834471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.874389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e9be-30fd-4abd-8cdf-2fb0fdb354d5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.920517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2280be0-45a7-4b86-83c8-45eaae468b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.921149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2280be0-45a7-4b86-83c8-45eaae468b38 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.921487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2280be0-45a7-4b86-83c8-45eaae468b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.921952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2280be0-45a7-4b86-83c8-45eaae468b38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.933090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2280be0-45a7-4b86-83c8-45eaae468b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d2280be0-45a7-4b86-83c8-45eaae468b38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:56.937725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:56.938622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:56.939794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:56.940561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30e5f4-c905-4d72-8b97-98997f635a6b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.940561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30e5f4-c905-4d72-8b97-98997f635a6b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.940561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30e5f4-c905-4d72-8b97-98997f635a6b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.951008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 213/425] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:56.951008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30e5f4-c905-4d72-8b97-98997f635a6b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.979565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45db93-6cb2-4bb0-98d3-22dc1387abf2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.016368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65601-4727-4afb-b307-d1f60038439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.017379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65601-4727-4afb-b307-d1f60038439b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.017652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.018075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65601-4727-4afb-b307-d1f60038439b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.018569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65601-4727-4afb-b307-d1f60038439b None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.020238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb65601-4727-4afb-b307-d1f60038439b None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.022154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb65601-4727-4afb-b307-d1f60038439b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.024324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 213/426] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.025781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.026287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.026783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.046271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:57.047756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:57.063546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30e5f4-c905-4d72-8b97-98997f635a6b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.100942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.102249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.102492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.102769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.103492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.103793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.105294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.114096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 214/427] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.114378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.115126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.124534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 214/428] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:57.125702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.232076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ed1b-84a0-4236-8f16-dd883a2f8e20 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.269594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.270828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.271589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.272086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.303275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cadf9-5614-4ae4-a5de-6faf9a3a0b89 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.357178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.365233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.366993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.370683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.410034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.410548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.410817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.411088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.411808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=b191ebef2f53453e846b638562cda626, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.412108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.413559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.424529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 215/429] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=b191ebef2f53453e846b638562cda626 => generated 611 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.474614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 215/430] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:57.481236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.523333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.658830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.665919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff886-620d-4f04-93b6-1d1304614101 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.666397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ea6a9-713e-46d3-86fc-4d3c8ab99691 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.707685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.708313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.708593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.708856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] PATH_INFO: `/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.709978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] RBAC: Authorizing `identity:get_project(project_id=2a7a9edcab5a4ec2997ce4702f7f3051)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.710858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.712064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.712171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.712343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.712621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.713738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 216/431] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/projects/2a7a9edcab5a4ec2997ce4702f7f3051 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.719078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.726325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:57.731280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:57.732206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:57.733010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 216/432] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:57.739789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.783669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.829102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da45e7-831c-4faf-a4a2-93b84631210c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.865712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.866344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.866626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.866881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.869203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.870930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.872818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 217/433] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.873162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b882c-6d8e-466d-a91e-ba2e612383a5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.879610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.916482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.917071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.917403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.917684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.918349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] RBAC: Adding query filter params (name=member) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.918653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.920008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.931575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 217/434] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:57.935496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.956700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.010660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56800304-65c8-4baa-9e5b-bc68dcc76019 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.044808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.059049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.059670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.059951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.060224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.060952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.061283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.061934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a743c-911e-43c5-9495-69fd23c00639 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.063744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e64b5-ec1e-4d16-967f-d476e030b7a7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.077304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=2a7a9edcab5a4ec2997ce4702f7f3051&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:58.077304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55009d-70f3-4a63-8fd1-e4fd5e88dc19 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.077304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55009d-70f3-4a63-8fd1-e4fd5e88dc19 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.077304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55009d-70f3-4a63-8fd1-e4fd5e88dc19 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.077752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 219/436] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:58.079973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513348b7-6c6c-4739-8f29-5445c03e0639 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.080260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513348b7-6c6c-4739-8f29-5445c03e0639 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.080535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513348b7-6c6c-4739-8f29-5445c03e0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.103016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-513348b7-6c6c-4739-8f29-5445c03e0639 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:58.104249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-513348b7-6c6c-4739-8f29-5445c03e0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:58.110907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.111637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.111992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.112340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.203801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.205217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.205367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 220/437] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:58.206887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd09e-332f-4ae7-af50-c8ae8c24aeb2 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.207296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd09e-332f-4ae7-af50-c8ae8c24aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.207577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd09e-332f-4ae7-af50-c8ae8c24aeb2 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.209038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 221/438] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:58.215682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.215973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.216235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.225401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.237663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:58.238870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:58.319339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 222/439] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:58.333301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 218/440] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:58.336369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.390322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.444420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf539-fd5b-4edb-8962-f422d5f1c0ec None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.480398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.480943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.481224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.481534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.482143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.482659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.484082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.486262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 223/441] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.491568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.610652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbef9-0c9e-46af-81d3-8d75eb55436b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.614267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef3693-e324-40cb-9213-d7f72785bf7b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.628441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.631119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.645104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.645827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.646370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.646647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.649511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.650135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.650416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.650690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.651809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.653309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.654844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 224/442] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.655595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.656814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:58.662295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:58.663191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:44:58.663995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 219/443] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:58.666125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.755109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250595a1-8b4f-466c-8480-052d1d3bb5c9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.764409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec0bf1-7d53-4474-9818-b080cefbf838 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.790756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.791388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.791664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.791939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.802058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:58.802361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.802959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.803236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.803507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.804219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=b191ebef2f53453e846b638562cda626, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.804525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.806003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:58.806751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:58.807729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:58.808500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:44:58.811694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 220/444] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=b191ebef2f53453e846b638562cda626 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.812826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.813049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 225/445] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:58.813730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.870733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.872139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.937839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af3c53-0e2a-409b-85c5-9893d377a230 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.939482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa86c8-2439-4922-9ae3-fe61c567439c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.977583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.978291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.978978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.978978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.979522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.979822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.981193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.983825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.984436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.984718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.987777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.987777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.987777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.988030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.991521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 221/446] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.997423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.005440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 226/447] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:59.006202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.123772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561bee2-fa9b-4a9a-92f4-d1573784b779 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.128017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d2c-9539-4a4e-abb9-63a104781aeb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.131257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.131410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.166130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.166742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.167025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.167297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.168836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.169474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.169756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.170033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.235891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.237384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.237695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.239146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.334914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 227/448] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:59.341607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 222/449] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:59.342568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.342664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.346873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.350262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.440654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23b994-13ef-4658-a90b-1f8a1d81758e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.443071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee3bab-5f1f-46e4-92d9-2187c71eac9b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.474515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.475135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.475412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.475712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] PATH_INFO: `/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.476808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] RBAC: Authorizing `identity:get_project(project_id=ef5d9282c24b4d00b4d4a768619e22cb)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.477080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.477736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.478017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.478275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.478374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] PATH_INFO: `/v3/projects/4505c484dadf4bf9be6a9beb28a78f22` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.479444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] RBAC: Authorizing `identity:get_project(project_id=4505c484dadf4bf9be6a9beb28a78f22)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.479876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 228/450] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/projects/ef5d9282c24b4d00b4d4a768619e22cb => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:59.480890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.486946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 223/451] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/projects/4505c484dadf4bf9be6a9beb28a78f22 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:59.487086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.487692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.555359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.558959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.584657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b99a6-dbc5-4adb-808c-2975c3e8c84e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.586514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8423d75-b71c-4aef-bcb5-c2ed165d0bca None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.619213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.619366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.619840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.619933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.620121 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.620230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.620394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] PATH_INFO: `/v3/groups/96ce4a7685d3466fa23bccce77528364` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.620483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] PATH_INFO: `/v3/groups/98238d70a14646ad9cac234ab1121cfc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.621531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] RBAC: Authorizing `identity:get_group(group_id=96ce4a7685d3466fa23bccce77528364)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.621631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] RBAC: Authorizing `identity:get_group(group_id=98238d70a14646ad9cac234ab1121cfc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.622966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.623065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.624685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 224/453] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/groups/98238d70a14646ad9cac234ab1121cfc => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:59.624788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 229/453] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/groups/96ce4a7685d3466fa23bccce77528364 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:59.630265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.630393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.728443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815d70-fa17-4021-b415-6b4dfa7c5e3e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.729590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9703148-0d1f-4c2b-8993-35c39b0cb67e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.760336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.760931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.761214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.761518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.762240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] RBAC: Adding query filter params (group.id=98238d70a14646ad9cac234ab1121cfc, role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=4505c484dadf4bf9be6a9beb28a78f22) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:59.762407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.762873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.762962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.763194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.763407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.763943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f920a-a5bc-4835-8dca-f006c285f35b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.764125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] RBAC: Adding query filter params (group.id=96ce4a7685d3466fa23bccce77528364, role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=ef5d9282c24b4d00b4d4a768619e22cb) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:59.764429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.765850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83b75-6b95-487a-9a94-cea881c8b807 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.769916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 225/454] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/role_assignments?group.id=98238d70a14646ad9cac234ab1121cfc&scope.project.id=4505c484dadf4bf9be6a9beb28a78f22&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:59.774519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 230/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/role_assignments?group.id=96ce4a7685d3466fa23bccce77528364&scope.project.id=ef5d9282c24b4d00b4d4a768619e22cb&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:02.153614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b1af-7dca-4659-bcdb-9e574a323294 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.154114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b1af-7dca-4659-bcdb-9e574a323294 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.154192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b1af-7dca-4659-bcdb-9e574a323294 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.155799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 226/456] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:02.161008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57fa5-50db-4751-bd6d-dd3307d6f619 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.161431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57fa5-50db-4751-bd6d-dd3307d6f619 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.161598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57fa5-50db-4751-bd6d-dd3307d6f619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.176080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:02.182066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-51c57fa5-50db-4751-bd6d-dd3307d6f619 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:02.183895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-51c57fa5-50db-4751-bd6d-dd3307d6f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:02.263957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 231/457] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:02.357740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5caaf-d4b8-4c4d-a37c-f9d2d1784962 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.358367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5caaf-d4b8-4c4d-a37c-f9d2d1784962 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.358839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5caaf-d4b8-4c4d-a37c-f9d2d1784962 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.360443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 227/458] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:02.365791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.366316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.366779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.391345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:02.393123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:02.474541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 232/459] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:02.629997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5caaf-d4b8-4c4d-a37c-f9d2d1784962 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:02.634824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:02.739858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5caaf-d4b8-4c4d-a37c-f9d2d1784962 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:02.773187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:02.781299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:02.781299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.781299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.781299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.795373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:02.796971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:02.853619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:02.854590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:02.855458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:02.855458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:02.855458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:02.858798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 228/460] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:02.863038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:02.891842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:02.933197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfe59-1a0e-4c9d-9d44-67471f59143b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:02.966880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:02.980727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:02.981399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.981734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.982005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.992578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:02.994180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-891f2110-268b-40aa-96e2-9a57980ddb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:03.009795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.010760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:03.011602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:03.011602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.011602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:03.011602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 233/461] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:03.012405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e225a3-b602-46c6-97ac-535e51e53704 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.012405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e225a3-b602-46c6-97ac-535e51e53704 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.012561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e225a3-b602-46c6-97ac-535e51e53704 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.013910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 234/462] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:03.014703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40890-9d83-489b-9ebd-83772c566a00 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.014979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40890-9d83-489b-9ebd-83772c566a00 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.015245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40890-9d83-489b-9ebd-83772c566a00 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.021073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 235/463] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:03.021073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40890-9d83-489b-9ebd-83772c566a00 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.024801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dad28-207b-4284-bd6a-f357aad115a4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.061852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.062607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.062896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.063169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.063810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.064110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.065530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb7c1d-f50a-4d8a-950b-625f44f13888 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.078731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 229/464] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:03.084301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c2a7-69b8-4e55-9828-d40c69b5771b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.084599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c2a7-69b8-4e55-9828-d40c69b5771b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.084875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c2a7-69b8-4e55-9828-d40c69b5771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.103486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-3688c2a7-69b8-4e55-9828-d40c69b5771b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:03.104669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3688c2a7-69b8-4e55-9828-d40c69b5771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:03.131739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40890-9d83-489b-9ebd-83772c566a00 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.150648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.170025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.170608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.170859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.171153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.171750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.172048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.173451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 230/465] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:03.174662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.174953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.175229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.181466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.193085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:03.194404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:03.209087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 236/466] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:03.210558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.242830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.274479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 231/467] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:03.275539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.390180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba16cb-fea2-4988-bb6b-9159d9bb31cf None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.403371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0886be-9a10-4293-9569-9a5242b5c085 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.428582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.429197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.429501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.430311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.430953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.432953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.465179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 232/468] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:03 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:03.466249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.488326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.488952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.489234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.489531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.490187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.491668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.545663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 237/469] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:03 2022] POST /identity/v3/users => generated 246 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:03.565734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.657287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.686857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4901b5-90d0-4d18-8640-cf071b9e3f17 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.720027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.743452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.744098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.744376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.744649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.756765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.758938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:03.777915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.778883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:03.779722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:03.779722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.779722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:03.781855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 233/470] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:03.787712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.803429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfdb4-609b-4c2c-965e-63d0257803b6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.842589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.843208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.843483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.843752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.855052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.856508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:03.875346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.876294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:03.877150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:03.877150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.877150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:03.877150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 238/471] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:03.882437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.894548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.918510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad09bc3-6e63-4c01-ab19-a74676888fb5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.969006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.969830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.970169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.970447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.971154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.971470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.972842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb50d-9d4d-424b-a50c-82c19bb62a52 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.986646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 234/472] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:03.992703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe365f6-228f-426a-aed2-0a750670ce43 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.992703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe365f6-228f-426a-aed2-0a750670ce43 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.992703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe365f6-228f-426a-aed2-0a750670ce43 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.992703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 235/473] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:03.993542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe365f6-228f-426a-aed2-0a750670ce43 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.999774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.016129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65578b07-3e62-469a-b36a-68312dc67a71 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.053235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.054277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.054797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.055267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.056102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:04.056618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.058224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ca80e-3df5-4020-b5ca-7376b78c6aab None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.070834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 239/474] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:04.072348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.072912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.073435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.093631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:04.095183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:04.112062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe365f6-228f-426a-aed2-0a750670ce43 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.151543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.152159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.152441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.152718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.153460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.155337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.170047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 240/475] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:04.171465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.176871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.183340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 236/476] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:03 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:04.270397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.297333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdfae-6e8c-4bb7-bcfb-5ff2d23f761f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.351378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.352543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.352825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.353099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.353777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.355280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.380365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 241/477] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:04 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:04.547836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.654442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f5bb-bed3-4fe5-92cc-1e03feb076f2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.691645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.692611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.693111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.693608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.694464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.696094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.707110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.sql.core [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:45:04.707110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:45:04.707110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [parameters: {'id': '32f8c1d65b6749588fdbfe47eb87f424', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:45:04.707110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81532) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:04.725069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:04.726042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application yield resource Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise self.value Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application session.commit() Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:45:04.727527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:45:04.728415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:04.732020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:04.734093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [parameters: {'id': '32f8c1d65b6749588fdbfe47eb87f424', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:04.736034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:45:04.738032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:04.741520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 237/478] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 07:45:04 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:04.747740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.874325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a25ad-8d0e-4612-82ba-71fac372457c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.921698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.927348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaee0ce-290c-4da3-b5ef-2ea49f7a8c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.928286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaee0ce-290c-4da3-b5ef-2ea49f7a8c74 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.928632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaee0ce-290c-4da3-b5ef-2ea49f7a8c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.928907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaee0ce-290c-4da3-b5ef-2ea49f7a8c74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.945302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaee0ce-290c-4da3-b5ef-2ea49f7a8c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-dfaee0ce-290c-4da3-b5ef-2ea49f7a8c74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:04.950897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:04.951766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:04.952574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 242/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:04.957918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:05.049755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:05.101097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292e0db-faa1-4ca0-b456-ecb3b8a85a8e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:05.150826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:05.151437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.151712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.151982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.152637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:05.152935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:05.154325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1cea5-1539-4952-94bd-767b5d386348 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:05.169001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 238/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:05.740553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262f7c4-7468-41a3-a639-e7dbb913163b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.741084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262f7c4-7468-41a3-a639-e7dbb913163b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.741084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262f7c4-7468-41a3-a639-e7dbb913163b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.743359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 243/481] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:05.748732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf44a-c98b-4d7f-94e9-ee4583122142 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.749579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf44a-c98b-4d7f-94e9-ee4583122142 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.750091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf44a-c98b-4d7f-94e9-ee4583122142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.776619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9bacf44a-c98b-4d7f-94e9-ee4583122142 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:05.778186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9bacf44a-c98b-4d7f-94e9-ee4583122142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:05.858824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 239/482] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:05.868648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f632-51b2-4443-be77-58bf95e29262 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.868927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f632-51b2-4443-be77-58bf95e29262 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.869199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f632-51b2-4443-be77-58bf95e29262 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.870755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 244/483] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:05.876019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.876310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.876584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.895084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:05.896558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:05.954497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:05.972880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 240/484] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:06.249467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f632-51b2-4443-be77-58bf95e29262 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.376991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f632-51b2-4443-be77-58bf95e29262 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.419941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.424712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.425699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.426210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.426679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.439847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:06.445740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:06.446656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:06.447498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:06.450602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 245/485] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:06.458348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.516375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:06.614164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835bb91-4bb0-448e-b020-f50f2f3fea84 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.630614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df22efc-7696-4e77-b4ba-14444a05d9ad None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.683027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.683658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.683938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.684212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.684882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:06.685392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:06.687842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:06.698373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.699012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.699292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.699565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.701952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 246/486] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:06.707930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.727185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:06.732021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:06.732930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:06.733769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 241/487] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:06.747295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.822821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e39d6a-68cb-440c-933d-74ac3d6fa73a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.833636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:06.838073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:06.862401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.863273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.863707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.865013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.880722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:06.883247 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:06.893495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb704-489a-4bb0-bcef-76147c214af8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2e061c3a-d314-4b3b-b1e1-f7220b99322e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:06.903713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:06.904834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:06.905929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:06.905929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:06.905929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:06.908570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 247/488] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:06.910256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436404-c21f-4fa1-aae0-671d68011673 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.910954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436404-c21f-4fa1-aae0-671d68011673 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.911377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436404-c21f-4fa1-aae0-671d68011673 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.914001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 248/489] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:06.914850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436404-c21f-4fa1-aae0-671d68011673 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.942779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.943419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.943701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.943978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.945919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:06.946227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:06.947735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6d2f6-8e8b-46a9-9d4c-25d918d312e7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:06.957133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 242/490] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:06.962722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4799-f398-4254-b906-ca772774f76c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.963001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4799-f398-4254-b906-ca772774f76c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.963279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4799-f398-4254-b906-ca772774f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.981806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-961c4799-f398-4254-b906-ca772774f76c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:06.983082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-961c4799-f398-4254-b906-ca772774f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:07.028161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436404-c21f-4fa1-aae0-671d68011673 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.053398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 243/491] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:07.055091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f089f4-8cdc-4dd0-a60c-fc7bf4961fbd None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.055378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f089f4-8cdc-4dd0-a60c-fc7bf4961fbd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.055651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f089f4-8cdc-4dd0-a60c-fc7bf4961fbd None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.057027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 244/492] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:07.061630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f089f4-8cdc-4dd0-a60c-fc7bf4961fbd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.072666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.073345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.073693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.073968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.074664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.074955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.076433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4b5c-ba73-4d7b-b01e-7a16a35910db None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.089745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 249/493] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.091032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.091318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.091589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.109535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:07.110771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:07.115418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.134769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.186551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 250/494] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:07.187818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.196047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f089f4-8cdc-4dd0-a60c-fc7bf4961fbd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.235478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.236109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.236387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.236657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.248258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.249932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:07.270343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:07.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:07.272520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:07.272520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:07.272520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:07.274837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 245/495] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:07.281028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.329628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b0acb-703c-4672-9f38-07c068bf8de3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.397967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.398670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.399061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.399338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.407226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.408786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:07.423425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:07.424366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:07.425308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 251/496] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:07.425873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.434047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.446345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927671-8201-483f-9478-1c6954bcc8c2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.448132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.493062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.493945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.494320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.494669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.495544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.495922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.498024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.517956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 246/497] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.517956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.551325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ad83-fc50-48ec-9615-7344023584d0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.591376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.591949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.592229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.592498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.604167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:07.609824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:07.610720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 252/498] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:07.614222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.629011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9eee-4d26-4a37-82a3-dad69dfea1ae None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.665744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.666580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.667045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.667325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.668054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.668360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.669817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.695364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.707549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 247/499] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.713451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.721186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249f3d7-4451-4bea-8577-c09adedddc99 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.723652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.761005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.761688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.762000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.762378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.771837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.774034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:07.785665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:07.786764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 253/500] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:07.787659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.814650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505293b-c511-4abf-9285-26e954bf5a1e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.849094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.849733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.849954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.850231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.860028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:07.864781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:07.865772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:07.866745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 248/501] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:07.868233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.888716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdce27-e39c-45c5-bb27-d556049b4134 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.920989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.921611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.921887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.922156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.922802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.923098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.924469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df363e6a-afd6-4fd3-9350-ff4754d6a6a3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.926581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.933720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 254/502] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.934854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2774d-6c1e-47c3-9286-aa7a02531c81 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.935142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2774d-6c1e-47c3-9286-aa7a02531c81 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.935243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.935416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2774d-6c1e-47c3-9286-aa7a02531c81 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.936661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 255/503] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:07.937318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2774d-6c1e-47c3-9286-aa7a02531c81 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.972626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcbbe-8596-4a6f-a789-0b9a7bacd286 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.006172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.006773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.007051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.007321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.035505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2774d-6c1e-47c3-9286-aa7a02531c81 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.069314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.069908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.070775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.071077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.071784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.072083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.073523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.073627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.074964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.108642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 256/504] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:08.109412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.138603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.168131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.173141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 249/505] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:08.173996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.212050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe184f5-2a0b-43b2-a425-36bdf029d7f3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.245357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.246040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.246315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.246586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.247235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.247537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.248893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea6aab-435e-4630-bafc-283568201737 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.256503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 257/506] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:08.257655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.257946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.258216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.272706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c458e-c989-474b-9e90-c2d9c9f1815b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.276231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:08.277457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:08.306926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.307549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.307834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.308110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.318173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.319608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:08.333802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.339755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:08.340906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:08.340906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.340906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:08.340906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 250/507] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:08.340906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.346809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 258/508] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:08.346809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.363415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.396686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.450531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c159-efab-4ba2-a63c-2f6e2617a6bf None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.451102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a536-07b2-4ccb-ab12-f0061892b3e9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.485939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.486546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.486829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.487107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.489497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf793-c912-47a0-962e-6156771082fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.490287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf793-c912-47a0-962e-6156771082fb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.490712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf793-c912-47a0-962e-6156771082fb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.490982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf793-c912-47a0-962e-6156771082fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.501505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf793-c912-47a0-962e-6156771082fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.503043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf793-c912-47a0-962e-6156771082fb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2febf793-c912-47a0-962e-6156771082fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:08.518553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.519433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:08.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:08.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.520274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:08.522176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 259/509] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:08.523078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf793-c912-47a0-962e-6156771082fb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.560986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.562529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.584893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.625486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.628506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf793-c912-47a0-962e-6156771082fb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.662803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.663431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.663713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.664558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.667243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 251/510] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:08.668065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.676487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.677979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:08.692614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.693552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:08.694388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:08.694388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.694388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:08.694388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 260/511] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:08.698084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.767505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0fb9b-c538-46bc-9003-f727e3f83c29 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.787518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.795362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c287-8af4-44ac-b71f-584ea01df849 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.801675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.802279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.802560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.802836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.803474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.803781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.805725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.816997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 252/512] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:08.817763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.836445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.837298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.837765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.838036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.838677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.838978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.840356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.853016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 261/513] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:08.853375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.871172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.917139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198227f5-e347-4029-ac87-084d8d8d66a7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.950423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.951048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.951322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.951601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.953801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3394c-a8ff-4083-aa63-f1e5fad3e4a0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.962469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.963902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:08.977787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.978721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:08.979583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:08.979583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.979583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:08.979583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 253/514] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:08.979838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.992536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.993143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.993452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.993717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.003586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.005009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.011358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:09.019783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.020679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:09.027058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:09.027058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:09.027058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:09.027058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 262/515] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.027058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.080130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d56fe-cd59-45f7-b915-9402ad5a427c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.085287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.113484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.114087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.114363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.114663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.115290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.115591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.116955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.122193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e5ba-14ce-4a7d-a90a-b6e0b9a47dca None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.128344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 254/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.129114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.156736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.157392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.157668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.157937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.165797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.167274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:09.178221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.179098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:09.180573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 263/517] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.181132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.225178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.234794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3be8d-05de-4704-8e72-17b5bcc179b9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.267070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.267690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.267963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.268237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.275440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.276870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.278269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3305b-b978-457f-aa90-7f4b76e6dbd5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:09.288316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.290075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 255/518] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.291194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.304760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.315438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.316033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.316315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.316585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.317215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.317545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.318912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.330926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 264/519] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.331741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.392289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d9390-9a98-46b9-8240-e106acc7b7f4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.425953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.426553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.426835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.427109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.427799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.428112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.429517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.437698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c56063-aaab-451c-b9d1-513b84c5cac4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.440964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 256/520] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.441800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.456108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.471780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.472406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.472683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.472945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.480442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.481926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:09.493115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.494139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:09.495041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 265/521] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.495592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.542194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825e94f-7e98-47b7-82d3-0e971e7c20a8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.542396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.575873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.576476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.576756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.577028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.577781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.578086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.579506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.595627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ac48-e472-4620-b569-13dcbf8c92b3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.596240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 257/522] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.597014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.633593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.634195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.634477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.634744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.635423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.635725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.637135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.654219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 266/523] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.654996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.664346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.696194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac682-5c04-4dff-8ff6-aedcc075301c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.729571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.730168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.730447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.730721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.731357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.732789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.755899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 258/524] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:09 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:09.756719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.757056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd854-6e5e-40d8-819a-84ef0a385ff7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.759486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.796679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.797367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.797651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.797930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.808314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.809923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:09.824331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.825282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:09.826153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 267/525] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.826657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.889296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6174-6159-45df-90a0-75ae65cda240 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.919023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.933522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.934140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.934411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.934688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.935420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.935725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.937168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.946043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16b10e-750c-4d16-bd9f-b5c6e95f4c3b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.957500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 259/526] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.958147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.987836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.988442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.988728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.989003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.021906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.060304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.061898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.065103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f59eb4-89c4-4596-9de0-cdbab5904a32 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.102550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.103243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.103600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.103947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.104730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=51791d40886b419fbaf269508382702e) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:10.105109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.106592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.117490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 260/527] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/role_assignments?user.id=51791d40886b419fbaf269508382702e&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:10.117490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.181970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 268/528] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:10.182915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.194495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.263739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.271138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e67c-7fc6-4bf6-83e5-6853d4a88010 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.314132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ae797-2c01-4667-bfc0-6ba7548260b7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.317335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.318142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.318568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.318984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.319814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:10.320815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.322530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.340963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 261/529] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:10.342621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.352100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.352800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.353085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.353389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.428251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.430494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.450063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417113-6cbc-4a52-9c1c-cda99d7a7127 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.459886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.486005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.486668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.486949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.487223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.498173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.499609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.513666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:10.514205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:10.515285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:10.516341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:10.516341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:10.516341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:10.519899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 262/530] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:10.520672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.545303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 269/531] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:10.546753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.623326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f24f7-306a-4023-8663-b78117ff2dcc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.654292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bbcfd-948d-47a5-ae81-bf0ecfc9192d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.658001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.658614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.658892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.659167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.659888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8324e7cb70744038987b7d15f002160f) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:10.660196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.661681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.668197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 263/532] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/role_assignments?user.id=8324e7cb70744038987b7d15f002160f&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:10.669127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.697519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.713417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.714495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.715042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.715519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.716375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:10.716983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.718850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.733023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 270/533] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:10.738734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.785741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.787375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d694b-7fd7-494f-9356-d4a946547f04 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.823977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.824627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.824904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.825175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.851460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.852935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.858043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca3c6-827e-43e7-8222-ca8e4e73269d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:10.884639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:10.885686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:10.886580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:10.886580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:10.886580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:10.894049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 264/534] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:10.899714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.900223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.901098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.901620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.902090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.910051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.911756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:10.924769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:10.925707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:10.926551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:10.928946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 271/535] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:10.942423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.997845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:11.022795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dabe2-e7de-40fa-8dbb-45739a47c6bb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.057763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.058294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.058574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.058847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.059491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:11.059792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.061162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.074241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 265/536] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:11.082229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:11.092998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:11.111670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bafd-0349-40e8-ad65-166fad6964f1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.150486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.151320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.152368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.152954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.154822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:11.155271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.157531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.182254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 272/537] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:11.188409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:11.264867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ccfac-add1-4294-b893-734db1bb5408 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.314175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.314945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.315350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.315703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.330288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:11.334386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.336493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.343701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a83067-cf6f-4ffb-8b57-88076e54fa3e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:11.362741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:11.363829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:11.364965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 266/538] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:11.374187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:11.400638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.401482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.401898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.402335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.403188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=7e67c56fb2c8419aa5ed846d5412e0c4) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:11.403632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.405201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.418166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 273/539] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:11 2022] GET /identity/v3/role_assignments?user.id=7e67c56fb2c8419aa5ed846d5412e0c4&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:11.542486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53b01f-a7e0-4c0c-b574-9f209e258d17 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.587699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.588544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.588984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.589417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.590265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:11.590706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.592286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41168f4-ce7f-479d-94a7-7b4080fe59ca None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.611617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 267/540] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:11.618346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:11.630878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:11.739060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4cc81-6b33-4d20-afb0-3c0b51627c12 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.788496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.789146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.789454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.789729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.790547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=f7a7f863bc194cefaec8d5fb79c670fc) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:11.790860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.792284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11a108-ef1f-4143-bc69-e73cc231a151 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.801852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 274/541] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:11 2022] GET /identity/v3/role_assignments?user.id=f7a7f863bc194cefaec8d5fb79c670fc&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:11.951450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b74a0-e8c1-4422-bd04-a4f817252ab1 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.951783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b74a0-e8c1-4422-bd04-a4f817252ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.952039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b74a0-e8c1-4422-bd04-a4f817252ab1 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.953668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 268/542] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:11.959510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4faf-2e3d-45e4-9f14-4ef5cbac8426 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.959799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4faf-2e3d-45e4-9f14-4ef5cbac8426 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.960077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4faf-2e3d-45e4-9f14-4ef5cbac8426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.986075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6adc4faf-2e3d-45e4-9f14-4ef5cbac8426 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:11.987305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6adc4faf-2e3d-45e4-9f14-4ef5cbac8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:12.075465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 275/543] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:12.268499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053951-1c32-4a9e-a8f6-2aff3bbf2296 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.268997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053951-1c32-4a9e-a8f6-2aff3bbf2296 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.268997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053951-1c32-4a9e-a8f6-2aff3bbf2296 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.270631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 269/544] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:12.276317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.276712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.276907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.288399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:12.306174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:12.307377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:12.405847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 276/545] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:45:12.508074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053951-1c32-4a9e-a8f6-2aff3bbf2296 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:12.588705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:12.643561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053951-1c32-4a9e-a8f6-2aff3bbf2296 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:12.687959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:12.688592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.688872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.689147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.706136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:12.712178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:12.713078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:12.713918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 270/546] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:12.719467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:12.830160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bdede-a94f-413c-9fce-89d1f84b74c5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:12.864604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:12.874086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:12.874691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.874968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.875240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.875897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:12.876259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:12.877565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:12.886629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 277/547] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:12.892051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:12.905558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.061694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b13823-14ff-4bad-a19d-8ac42781513d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.091881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045f4e-cbf9-4cff-babb-165d794e0766 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.118774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647a3c3-a668-4cc2-8a62-e0ff98a7533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.119331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647a3c3-a668-4cc2-8a62-e0ff98a7533e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.119608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647a3c3-a668-4cc2-8a62-e0ff98a7533e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.119877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647a3c3-a668-4cc2-8a62-e0ff98a7533e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.126190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.143631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647a3c3-a668-4cc2-8a62-e0ff98a7533e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:13.148370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.149006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.149309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.149587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f647a3c3-a668-4cc2-8a62-e0ff98a7533e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:13.150802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.151638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:13.152430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:13.155012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 278/548] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:13.156494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640491ad-06a2-456b-a310-71236e36acff None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.157069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640491ad-06a2-456b-a310-71236e36acff None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.157563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640491ad-06a2-456b-a310-71236e36acff None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.163049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.163177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 279/549] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:13.163251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.163320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640491ad-06a2-456b-a310-71236e36acff None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-631fe43a-150f-46fe-9959-2cf81de2839d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:13.178803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.181116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 271/550] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.182504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.202925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:13.204129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:13.237695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.276927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640491ad-06a2-456b-a310-71236e36acff None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.277824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 272/551] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:13.278599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.313473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.314178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.314460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.314727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.315378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.315780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.317225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.326658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 280/552] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:13.332055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.443197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.450342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cde019-2703-4e61-9d96-8cd478367943 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.516062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.516662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.516944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.517213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.517881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.518853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.521698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.541929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 273/553] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:13.543781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db4410-370b-4b9d-8780-04295cd57e01 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.546158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.569625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.597301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.598276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.599185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.599909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.614527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.616126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:13.631490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.633074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:13.634498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:13.634498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:13.634498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:13.634498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 281/554] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.635398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.667474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182d45-c502-493c-bca5-db2d897b0405 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.705332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.705903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.706183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.706459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.714868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.716316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:13.729315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.730255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:13.731206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 274/555] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:13.731857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.754494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.758321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f258-28a0-4dc6-b813-3dfbcf20e3ce None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.797966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf135a8-6fd0-4782-8571-f016f0a2f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.798614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf135a8-6fd0-4782-8571-f016f0a2f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.798898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf135a8-6fd0-4782-8571-f016f0a2f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.799175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf135a8-6fd0-4782-8571-f016f0a2f1f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.810305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf135a8-6fd0-4782-8571-f016f0a2f1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8bf135a8-6fd0-4782-8571-f016f0a2f1f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:13.816270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.817161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:13.818019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 282/556] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.819525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbeff1-be61-4b9a-9f3e-c2e966795487 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.819525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbeff1-be61-4b9a-9f3e-c2e966795487 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.819525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbeff1-be61-4b9a-9f3e-c2e966795487 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.821212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 283/557] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:13.821940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbeff1-be61-4b9a-9f3e-c2e966795487 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.851386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c6c7-b4ce-4e6d-b7b4-77810ab9bf1a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.853597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.889353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.889964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.890291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.890565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.891221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.891621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.892902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658668b9-cac5-4643-8f64-8ae74f49fd26 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.909785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 275/558] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:13.909785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47996290-97e4-4108-8731-d6626af401d4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.909785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47996290-97e4-4108-8731-d6626af401d4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.909785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47996290-97e4-4108-8731-d6626af401d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.925772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-47996290-97e4-4108-8731-d6626af401d4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:13.926941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-47996290-97e4-4108-8731-d6626af401d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:13.940043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbeff1-be61-4b9a-9f3e-c2e966795487 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.974835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.975361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.975638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.975907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.976686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.976989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.978464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.000947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 284/559] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.000947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.011072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 276/560] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:14.011840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47996290-97e4-4108-8731-d6626af401d4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.022416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.116305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.129245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47996290-97e4-4108-8731-d6626af401d4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.137666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708667f7-a35c-4e9d-83c7-62b04269414e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.166798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.167505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.167702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.167968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.176798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.178471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.186486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.187203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.187577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.187960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.188711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.189108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.190581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200db14-0277-4a57-a10a-090725359c7c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:14.191185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.192258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:14.193224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 277/561] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.194181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.209480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 285/562] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.209480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2c296-c9cc-4b1e-8f96-e0e5d6498022 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.209480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2c296-c9cc-4b1e-8f96-e0e5d6498022 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.210052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2c296-c9cc-4b1e-8f96-e0e5d6498022 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.211362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 286/563] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:14.212403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2c296-c9cc-4b1e-8f96-e0e5d6498022 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.265887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.300357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb63f75-0ef0-4e76-801c-0eeafa3e02fd None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.318655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2c296-c9cc-4b1e-8f96-e0e5d6498022 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.333185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6d591-f95c-44fb-a053-c0489fc7f3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.333810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6d591-f95c-44fb-a053-c0489fc7f3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.334088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6d591-f95c-44fb-a053-c0489fc7f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.334378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6d591-f95c-44fb-a053-c0489fc7f3f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.353820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.354428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.354713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.354984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.355715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.356020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.357486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.374286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 287/564] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.376538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.387473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.401801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6d591-f95c-44fb-a053-c0489fc7f3f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.403267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6d591-f95c-44fb-a053-c0489fc7f3f4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.465588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.479273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90f9c-41c3-4548-b1b7-006c73d60f92 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.499562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 278/565] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:14.500882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.501271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.501629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.513098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.513772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.514030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.514301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.518882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:14.520006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:14.524372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.525847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:14.540322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.541479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:14.542411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:14.542411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.542411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:14.542411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 288/566] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.542643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.587083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 279/567] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:14.587968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.601150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.649706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bd14a-e10b-4bd4-8382-0bb2810e187e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.689542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.690801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.691660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.692058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.692596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.693863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f8cb5-3228-4cb2-971f-0ab28615a702 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.706314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:14.715353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.716315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:14.717161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:14.717887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 289/568] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.718794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.736704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.737362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.737641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.737906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.749282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.750708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:14.766585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.767519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:14.768435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:14.768435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.768435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:14.768435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 280/569] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.768658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.832674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e840-8e6e-4c0a-b8dc-a3decb0ab4c9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.852951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.875701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3afec5-a9a4-49fe-a229-ad84f4b04548 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.878555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.879382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.879823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.880256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.891615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.893861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.910007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.910604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.910879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.911149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:14.911764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.912908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:14.914570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:14.914570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.914570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:14.914752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.914752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.914752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.915009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 290/570] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.915497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.929019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 281/571] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.930481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.944491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.017020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3419e3-364a-4845-9ea5-44454954c59d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.030960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab077-23b4-405a-aa4e-13a2641c817c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.050419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.051026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.051305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.051577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.052228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.052528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.053925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.061774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 291/572] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.062623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.065031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.065725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.066004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.066374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.066887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.067182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.068530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.080224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 282/573] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.081112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.099600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.149072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.169345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b8fc5-1d00-4c39-a514-b5a6bc6764d6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.180280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd9c9-db8b-4654-9fc4-21647b457e3e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.202651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.203269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.203546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.203816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.212852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.213479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.213759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.213852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:15.214034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.214669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.214972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.216336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:15.218974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:15.220087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 292/574] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:15.220933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.232724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 283/575] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.232724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.312425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.322493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2097d7-2b32-4432-a19f-0aeb3c2f6237 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.328730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680f661-6eb5-40b3-bccd-30db4942a62c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.357910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.358470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.358749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.359019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.362169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.366477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.368422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.368772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.369432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.369716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.369993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:15.379091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:15.380202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:15.381136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:15.381701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.381774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 293/576] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:15.381774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.381904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:15.400440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:15.406221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:15.407364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:15.407364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:15.407364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:15.407364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 284/577] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:15.407364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.481198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0cc6-b638-4775-8bbc-e200a7206274 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.501301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a83fb5-bfc1-4317-b97f-7d49da1c19e2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.513877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.514491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.514768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.515038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.521970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.523895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.534098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.534691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:15.534861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:15.535859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:15.536998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:15.537461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.537461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.537461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.537461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.537719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 294/578] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:15.537719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.537846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.550125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 285/579] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.550125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.556885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.590951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.643311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18dfee-d131-4097-9dfe-2e5745cc43bd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.644552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580031b-0265-4d8a-81c0-d135a615d29e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.675843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.676463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.676744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.677017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.677490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.678082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.678360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.678632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.679374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.679679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.681107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.683629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.685045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:15.696430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:15.697496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 295/580] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:15.698642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.701559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 286/581] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.702367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.770538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.801174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ce66-ca56-4f70-87e8-4b1e25430a13 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.802509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554a397-25d9-423c-8ac1-af42e75d4087 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.803988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.834571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.835171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.835465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.835726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.836358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.836659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.836762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.837338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.837617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.837893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.838064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.838566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.838866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.840269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.849423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 296/582] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.850207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.852404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 287/583] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:15.853156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.950007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117092d0-6f34-46d9-be96-7b8104099afc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.952412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a82b-85e0-4456-8a9f-d3b1bda9b0e5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.983076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:15.984105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.984852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.985192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.985584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.988640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.989362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.989711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.990049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.996199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.997664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.000371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.001837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:16.011286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:16.012401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:16.013331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:16.013331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:16.013331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:16.013331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 288/584] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:16.013331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:16.015857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:16.016758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:16.018642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:16.018642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:16.018642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:16.018642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 297/585] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:16.018642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.030332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.113515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155a02-c28d-4d14-b97d-b932b9fca9fc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.115721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ca507-a2cb-4f4c-bad5-51970011b5d0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.145918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.146774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.147060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.147330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.148575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.148699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:16.148916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.149195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.149505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.149780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.150375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.157239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.159078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.167479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 289/586] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:16.167479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:16.171016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:16.171925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:16.172947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 298/587] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:16.173556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.217057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.240473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.264802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334f8a-1c8f-4941-bb59-e13d09b77290 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.271577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79db79e-f106-4779-a609-1ed043739ff6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.299815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.300464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.300747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.301023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/51791d40886b419fbaf269508382702e/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.304979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.305605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.305890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.306164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.306805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:16.307109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.308467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.315186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=51791d40886b419fbaf269508382702e, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.316604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.320411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 299/588] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:16.321201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.330041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 290/589] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:16 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/51791d40886b419fbaf269508382702e/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:16.330846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.437780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3c6e-9c6c-4499-b179-33e234d7b306 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.440916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.453928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1926be-2417-4438-88dc-c115d242974c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.480465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.481002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.481310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.481587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.482229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:16.482534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.483905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.484712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.497463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 300/590] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:16.498303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.502121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.502743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.503024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.503299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.504033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=b2f9c8b7933e4742a5023154e9fd2218) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:16.504342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.505984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.512454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 291/591] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/role_assignments?user.id=b2f9c8b7933e4742a5023154e9fd2218&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:16.513295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.617685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5bc5-044a-41e2-a3b4-102e75206a63 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.646066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1d8f-1f18-4584-8c5b-17b2aa132284 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.657099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.657773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.658115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.658392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.659130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:16.659436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.660904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.686957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 301/592] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:16.688558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.692312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.693055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.693462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.693829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.701490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.703042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:16.714689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:16.715819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:16.716930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:16.722951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 292/593] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:16.723893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.728224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.776385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:16.812069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcdf3c-d265-409d-9f68-1ca5266e9995 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.837306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d9f7d-cb08-4a85-bc74-96567db6b181 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:16.857070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.857875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.858248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.858631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.873160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.879261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.886137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:16.887285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.887720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.888141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:16.892700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:16.893874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:16.895062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:16.901611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 302/594] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:16.902559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.903761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:16.905660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:16.924822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:16.926025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:16.927134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:16.927134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:16.927134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:16.934744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 293/595] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:16.934744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:16.996632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.017922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffac9a-79eb-459a-9428-3138fb90d303 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.052994 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.053567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.053843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.054107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.055378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.055745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.057220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.071636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.074768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 303/596] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.075806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2984-6583-4c35-816e-e080d73be719 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.075968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.113539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.114140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.114415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.114685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.115398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.115699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.117849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.140031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 294/597] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 07:45:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.140898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.191056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346739-4dfa-492d-9d13-6e386b6267d4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.228150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.228762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.229041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.229360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.230093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.230399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.231751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.241854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071dc9d-242e-4b4b-9f36-75b3c8fe2907 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.249051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 304/598] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.250034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.252695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.278367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.279203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.279337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.279596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8324e7cb70744038987b7d15f002160f/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.294983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=8324e7cb70744038987b7d15f002160f, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.296523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.317417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 295/599] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:17 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8324e7cb70744038987b7d15f002160f/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:17.318683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.334104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.394024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23f9b7-aaa4-4bcd-bed4-e908a9639061 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.476983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e336ae-70a3-4913-afd8-5ebc97390942 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.503782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.504479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.504713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.504987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.524533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.525327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.525538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.525652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.525865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.527176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.534129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.536242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:17.546100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:17.547309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:17.548407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:17.548407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:17.548407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:17.550370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 305/600] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:17.554752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:17.555804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:17.556912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:17.557468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.558876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 296/601] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:17.565862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.663475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.677632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.722971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c094d-fafc-4072-a459-52e510d5aefd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.743644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfee5c-bcdc-412b-a4c0-b0be02c84d0f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.786732 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.787349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.787634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.787903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.788545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.788877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.790266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.809441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.810058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.810337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.810612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.811306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.811613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.813106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.816851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 306/602] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.823221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.840496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 297/603] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:17.846265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.971392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bfe30-95ce-4601-b3b4-337f1dbe1833 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.987709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:18.010035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586d3a9-7527-4011-9220-6f8595250bce None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:18.034486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.035132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.035462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.035743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.044807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:18.048642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.050570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.053540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.054199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.055066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.055338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/7e67c56fb2c8419aa5ed846d5412e0c4/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:18.073373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:18.074522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:18.075634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 307/604] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:18.077232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:18.093391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=7e67c56fb2c8419aa5ed846d5412e0c4, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.095059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.118128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 298/605] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:17 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/7e67c56fb2c8419aa5ed846d5412e0c4/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:18.207678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fb50-83f3-409b-9439-e003b97b134d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:18.245816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.246696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.247128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.247593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.248515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:18.248971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.250690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b94b6-354c-4768-8f12-5cc5c9d64d67 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.264137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 308/606] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:18.269845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:18.399395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad506eff-5f9a-4a3b-9372-3d7e298d52a9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:18.437175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78e4a8-68d9-4eca-a54e-4bffc36062f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.437942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78e4a8-68d9-4eca-a54e-4bffc36062f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.438224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78e4a8-68d9-4eca-a54e-4bffc36062f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.438539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78e4a8-68d9-4eca-a54e-4bffc36062f1 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/f7a7f863bc194cefaec8d5fb79c670fc/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.451262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ca6fa-1198-4de3-b651-263f4a3c9a92 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.451543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ca6fa-1198-4de3-b651-263f4a3c9a92 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.451821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ca6fa-1198-4de3-b651-263f4a3c9a92 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.453506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 309/607] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:18.457708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78e4a8-68d9-4eca-a54e-4bffc36062f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=f7a7f863bc194cefaec8d5fb79c670fc, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.458587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649f5fb-96bb-4d52-aeb5-b5245a97c9d8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.458882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649f5fb-96bb-4d52-aeb5-b5245a97c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.459155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649f5fb-96bb-4d52-aeb5-b5245a97c9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.459258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78e4a8-68d9-4eca-a54e-4bffc36062f1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.473717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 299/608] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:18 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/f7a7f863bc194cefaec8d5fb79c670fc/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:18.481218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2649f5fb-96bb-4d52-aeb5-b5245a97c9d8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:18.482515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2649f5fb-96bb-4d52-aeb5-b5245a97c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:18.517629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:18.568275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 310/609] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:45:18.584099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ab78-3db1-4366-b07c-b3a2899b83e6 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.584741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ab78-3db1-4366-b07c-b3a2899b83e6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.585221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ab78-3db1-4366-b07c-b3a2899b83e6 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.587003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 300/610] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:18.592561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.593132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.593657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.615042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:18.616695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:18.713668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 311/611] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:18.857491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ab78-3db1-4366-b07c-b3a2899b83e6 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:18.904562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.000796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ab78-3db1-4366-b07c-b3a2899b83e6 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.036471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.037101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.037412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.037688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.047034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.048822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:19.053788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:19.054756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:19.055754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 301/612] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:19.065004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.182883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.192682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423f1a0-838e-4fb1-92a7-250f6441feb8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.232500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.233405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.234176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.235200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.251262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:19.256408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:19.258153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:19.259226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:19.261606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 312/613] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:19.268972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.272213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.284863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f879-667b-45ad-a967-c10d6f696024 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.363365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.364048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.364332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.364606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.365299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:19.365610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:19.367609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:19.387733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 302/614] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:19.395144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668b733-995b-48e9-b311-8563e0bf7c07 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.395279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.443398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.444355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.444876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.445370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.446242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:19.446739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:19.448313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:19.465741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 313/615] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:19.471386 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.500960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.572135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1963-b209-4392-b887-0b5ab0b4fb11 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.610511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.611140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.611417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.611687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.622977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:19.624467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:19.641934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:19.642889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:19.643781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:19.643781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:19.643781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:19.644674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 303/616] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:19.665216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.669566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.703305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2878-1f92-4c3c-b43b-3373eb34f721 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.737821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.738456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.738892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.739172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.751061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:19.752507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:19.772754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:19.773885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:19.774760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:19.774760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:19.774760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:19.782059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 314/617] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:19.787736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.890407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0fd56-1577-4b05-b014-df4eb52e11d2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.899155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.938641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.940295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.941056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.941576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.942431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:19.942788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34f5fa-5a0e-4c9f-bc62-21d0f8769bdf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:19.943173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:19.945984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5db20-3c3e-4ae0-ae61-cae12c41bbdd None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:19.962750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 304/618] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:19.964402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dd196-94aa-4b21-8289-135c3826491b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.964906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dd196-94aa-4b21-8289-135c3826491b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.965436 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dd196-94aa-4b21-8289-135c3826491b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.967367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 305/619] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:19.969115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dd196-94aa-4b21-8289-135c3826491b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:19.994989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:19.995596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:19.995873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:19.996136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:19.997029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:19.997370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:19.999202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bdef9-4258-4ab4-9bf6-aba54d06c321 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.015565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 315/620] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:20.016833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.017118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.017435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.041535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:20.043075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:20.049270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.090296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dd196-94aa-4b21-8289-135c3826491b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.122363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 316/621] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:20.123596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.138563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.139198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.139472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.139736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.153297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.154766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:20.185602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:20.186598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:20.187551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 306/622] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:20.193775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.195438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.239910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd37664-4df1-4060-8078-2f1dd1644d76 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.278514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.279501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.280043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.280527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.289723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.292102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:20.306115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:20.307103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:20.308029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:20.311805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 317/623] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:20.317452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.438983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebc062-dbd4-4c66-bb17-482e73388300 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.449620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cf68d-3956-4c3e-a660-d32de4e8d615 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.467692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.478384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.488915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.489764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.490240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.490656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.491190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.492253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:20.492368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.492595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.492869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.493101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.493629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:20.493939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.494991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.495350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1e0a-ad33-4820-b5ee-2136e977180f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.514558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 307/624] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:20.515878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c323be4-3f9d-4cc5-901e-24d6e0bc4f22 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.516168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c323be4-3f9d-4cc5-901e-24d6e0bc4f22 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.516447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c323be4-3f9d-4cc5-901e-24d6e0bc4f22 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.518108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 318/626] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:20.522209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 308/626] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:20.522902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.524672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.524672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.524672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.543141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:20.544341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:20.615079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 309/627] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:45:20.616008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.632313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f0908-6767-4bd0-8957-da520d563836 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.668932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.669564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.669841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.670109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.723129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.752810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.754214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.755025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29976752-07e5-4540-9bd1-300d61bfa7aa None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.791627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.792263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.792543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.792821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.803652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.805904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.813474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:20.830573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:20.831652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:20.832602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:20.832602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:20.832602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:20.834538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 310/628] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:20.835476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.869419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 319/629] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:20.869419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.944760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.953035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7df84-0f33-492d-90e4-592ca2c77231 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.968791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83eb94-7e04-4e02-8fce-266f7bdc8c5b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.985869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1b4d3-1de1-4c5f-86e6-9092444cceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.986494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b4d3-1de1-4c5f-86e6-9092444cceaa None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.986776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b4d3-1de1-4c5f-86e6-9092444cceaa None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.987062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b4d3-1de1-4c5f-86e6-9092444cceaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.997057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1b4d3-1de1-4c5f-86e6-9092444cceaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-39d1b4d3-1de1-4c5f-86e6-9092444cceaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:21.002297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.003257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:21.004095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:21.005217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.005217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.005404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 311/630] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.005475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.005475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.005475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.005656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71da50-fbfe-4fca-81fc-6cba8e331820 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.005726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.005794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71da50-fbfe-4fca-81fc-6cba8e331820 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.005794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71da50-fbfe-4fca-81fc-6cba8e331820 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.006158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.006505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 312/631] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:21.007197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71da50-fbfe-4fca-81fc-6cba8e331820 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.020837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 320/632] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:21.021956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.033500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.108678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71da50-fbfe-4fca-81fc-6cba8e331820 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.120261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53552761-9caa-4a0f-9002-40d750bdc5cd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.142374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.142991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.143264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.143534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.154156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05229169-9f62-4eaa-89be-0202817bdcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.154640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.154758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05229169-9f62-4eaa-89be-0202817bdcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.155035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05229169-9f62-4eaa-89be-0202817bdcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.155300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05229169-9f62-4eaa-89be-0202817bdcb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.156059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.157918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.166153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05229169-9f62-4eaa-89be-0202817bdcb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:21.170807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.171837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:21.172740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:21.172740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.172740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-05229169-9f62-4eaa-89be-0202817bdcb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:21.172922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.173801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:21.174634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:21.175278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 313/633] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.175349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 321/634] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.175349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.175349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.175349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.176810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.191607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:21.192789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:21.250408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.258472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 322/635] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:21.266241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.276395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6381f38-88ba-43b8-a90d-730cd1e56726 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.309835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.310433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.310904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.311012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.311623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.311917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.313294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.326239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 314/636] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:21.326239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.383031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf7da-40e0-48b6-83c7-6f8b889f7278 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.410250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.420771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.421424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.421700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.421966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.430083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.431497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.433300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c16c-8cd0-4bd3-af21-c9257a8f290a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:21.442446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.443334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 323/637] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.444296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.475825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.476461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.476739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.477017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.477711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.478024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.479355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.481856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.493405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 315/638] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:21.494229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.556448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9ffff-49bc-41c7-99bf-969e964d88da None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.588687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.589292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.589571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.589836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.590462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.590757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.592100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.593643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747132a-b3f2-4f02-8667-06aa4e2f5577 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.603848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 324/639] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:21.604624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.627968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.628593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.628873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.629146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.639405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.640832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.650974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:21.654925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.656031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:21.656934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:21.656934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.656934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:21.656934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 316/640] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.656934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.709447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196bb6f-2ad3-449f-bdac-735c8dfec83f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.711751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.743113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.743798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.744085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.744357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.745036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.745372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.746790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.758503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 325/641] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:21.759090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.761689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c840d5-c301-4ae1-af50-a4a728ad6244 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.796081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.796699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.796977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.797247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.807510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.808896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:21.823184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.824323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:21.825457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:21.825457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.825457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:21.825457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 317/642] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.825457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.862827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338f98-d33a-4ff5-bad7-862628985460 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.869499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.897165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.897813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.898690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.898964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.908851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:21.914100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.915041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 326/643] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.916034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.925081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc49d4-ce26-4c11-92e7-18e4e1444fe6 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.926645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.959652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.960283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.961115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.961412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.968580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.970033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:21.982155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.983044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 318/644] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.983952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.017440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a54bf-7578-4361-853b-50ecabebc2e1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.051803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.052400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.052678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.052948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.053618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.053920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.055304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.066726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 327/645] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.067453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.082961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea95b-6031-4fdb-b4e3-5527f135cc4f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.093677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.116291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.116964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.117241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.117538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/b2f9c8b7933e4742a5023154e9fd2218/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.131192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=b2f9c8b7933e4742a5023154e9fd2218, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.132648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.145341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 319/646] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:21 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/b2f9c8b7933e4742a5023154e9fd2218/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:22.154279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.168576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9f74-83a4-420f-b4d1-cd03174c6682 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.170809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.207334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.207960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.208235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.208499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.209145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.209506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.211457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.225929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 328/647] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.227701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.276966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5438a9-d483-4f0c-96b1-253e14000c28 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.316680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.317374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.317608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.317878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.318542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.318843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.320776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.326772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.330428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 320/648] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.331139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.344282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4d5c3-4e67-4f08-8f48-7a99f5156c40 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.381830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.382461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.382740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.383009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.383693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.384024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.385663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.397697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 329/649] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.398533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.421596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.449098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87333a-6876-45db-8bcb-256f4d4aaa30 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.485177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.485949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.486228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.486503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.495364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.496793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.507482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2596a3-9707-4d31-ba9a-c24b8627da23 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:22.507808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:22.508725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 321/650] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:22.509720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.545037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.545695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.546225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.546225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.553775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.555809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:22.566865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:22.568063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 330/651] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:22.569092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.582384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.630896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd155-f2fb-4271-a716-3b7f2d7f7467 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.666470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.667149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.667428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.667757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.669662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.679929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.681521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.682408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa73e28-8a07-4fab-8fb9-bc3263e6dfe4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:22.696107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:22.697069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:22.698298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:22.698298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:22.698298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:22.698298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 322/652] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:22.698298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.724940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.725685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.725986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.726349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.727130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=51791d40886b419fbaf269508382702e) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.727426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.728937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.745635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 331/653] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/role_assignments?user.id=51791d40886b419fbaf269508382702e&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.745635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.826499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.832595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ff34-86aa-4a01-9410-219b6e0f059a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.866174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae1a55-49f6-4fb1-8591-e85b9565b5a8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.879328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.879952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.880232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.880536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.881381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.881803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.883354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.905136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.906677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.907057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.907446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.908277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.908683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.910257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.915725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 323/654] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.917411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.929614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 332/655] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.930561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.975545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.049606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60016cf-90c6-4c4c-931c-88e11e58e53a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.067212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465ec1-f775-4224-979b-a2ffdc2e6e59 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.094211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.095169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.095549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.095924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.096924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:23.097354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.099537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.101429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.111261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.112193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.112641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.113060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.120002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 324/656] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:23.120002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.199353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.201478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.251115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bcb62-53a7-4fc0-bedf-46b6b17f38b1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.254059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.293652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.294684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.295291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.295767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.326640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 333/657] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:23.327857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.363066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.380850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.382774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.453178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0544e-4205-4242-865e-04459b140359 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.494887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.495984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.496590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.497160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.504197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 325/658] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:23.505148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.505720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.507519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.508267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:23.525466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:23.526517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:23.527513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:23.535582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 334/659] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:23.536752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.625507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec416a2-b979-41b1-bb00-7b8f40bf827a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.637944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.653688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2b3b6-eea2-4aa4-bab7-1d1f378fc1f5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.668223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.668877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.669137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.669440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.682980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.684601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.693535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.695661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.696179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.696670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:23.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:23.702775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:23.703745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:23.703745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:23.703745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:23.705426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 326/660] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:23.708076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.717819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.719595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:23.736917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:23.738588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:23.739516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:23.739516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:23.739516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:23.742740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 335/661] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:23.743904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.777969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.833829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b57bd-e898-409d-8f36-550d81aca6e0 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.866392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd59a8-0a4b-409f-8565-7c3b699b1ea8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.874912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.875588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.875816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.876094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.877331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:23.877649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.879442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.901416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 327/662] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:23.902290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.908482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.909094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.909405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.909677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.910415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:23.910719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.912077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.923011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.928053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 336/663] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:23.929029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.009160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c25ec-7880-4018-be21-7c1d439dc26b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.024633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.041890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51310533-cdba-4111-b670-7a35e22259b8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.047580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.048365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.048786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.049231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.050571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:24.051022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.052993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.073570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 328/664] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:24.073570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.086500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228495a-04dd-4760-bf16-aecdd705a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.087122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228495a-04dd-4760-bf16-aecdd705a41c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.087406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228495a-04dd-4760-bf16-aecdd705a41c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.087677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228495a-04dd-4760-bf16-aecdd705a41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.174132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.176619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228495a-04dd-4760-bf16-aecdd705a41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.178445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228495a-04dd-4760-bf16-aecdd705a41c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.204359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf3bd5-48bb-49f5-8bc1-2ff6caae7145 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.241012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.241691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.241970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.242245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.249505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.251166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:24.263767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:24.264848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:24.265976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:24.269593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 329/665] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:24.270200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.289617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 337/666] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:24.289617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc937-860a-40e2-9b6d-5d7c5b968b11 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.289617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc937-860a-40e2-9b6d-5d7c5b968b11 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.289617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc937-860a-40e2-9b6d-5d7c5b968b11 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.289617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 338/667] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:24.289617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc937-860a-40e2-9b6d-5d7c5b968b11 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.312496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.389945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.392335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c143d-7544-45dc-a8c9-cdb06c8e0b47 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.394171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc937-860a-40e2-9b6d-5d7c5b968b11 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.428989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.430137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.430387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.430522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.430721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.430989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.431264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.431532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.432205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:24.432503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.433951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.438172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.439764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.450918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 339/668] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:24.450918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-aecfda55-ffdd-47f5-bc26-93ea12973cf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:24.457001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:24.458203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:24.459239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 330/669] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:24.459837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.464536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.464536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.479242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:24.480425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:24.557398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 331/670] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:24.558431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac51b84-6d94-4aa7-8a59-36b8199ccb1e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.558633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.592078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.596334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.596966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.597280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.597554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.609110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.610577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:24.625493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:24.626728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:24.627834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:24.627834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:24.627834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:24.631122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 340/671] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:24.631944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.647542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.691908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765738d8-8eba-46ee-8228-9c7bd59339a6 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.728621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.729252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.729552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.729822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.730548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8324e7cb70744038987b7d15f002160f) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:24.730851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.732272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.741308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 332/672] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/role_assignments?user.id=8324e7cb70744038987b7d15f002160f&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:24.741308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.790894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27998d-0cbd-4574-823e-8d9dad8e8725 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.841486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.842286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.842674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.843325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.844624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:24.845046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.846685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.863866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 341/673] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:24.864966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.892969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.907752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264139-a49d-49ea-ab7a-1dae1609d1de None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:24.948943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:24.949517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.949793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.950068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.950703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:24.951003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:24.951452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.952698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:24.966082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 333/674] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:24.966905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:24.988232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23451833-f1a0-4fd5-b270-b7540e581507 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.026735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9a0e-052a-4ce9-a915-a0607a980f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.027369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9a0e-052a-4ce9-a915-a0607a980f26 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.027653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9a0e-052a-4ce9-a915-a0607a980f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.027927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9a0e-052a-4ce9-a915-a0607a980f26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.038368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d9a0e-052a-4ce9-a915-a0607a980f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-031d9a0e-052a-4ce9-a915-a0607a980f26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:25.043616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:25.044742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:25.045795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 342/675] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:25.051354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956583e6-2dd2-4fbb-9278-ea9392444c43 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.051747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956583e6-2dd2-4fbb-9278-ea9392444c43 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.052133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956583e6-2dd2-4fbb-9278-ea9392444c43 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.053947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 343/676] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:25.057979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956583e6-2dd2-4fbb-9278-ea9392444c43 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.086035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e5c65-88ca-4aa7-9f5a-0f31f82d5294 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.126430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.127040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.127315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.127585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.128318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=7e67c56fb2c8419aa5ed846d5412e0c4) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.128631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.130149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.141425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 334/677] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:24 2022] GET /identity/v3/role_assignments?user.id=7e67c56fb2c8419aa5ed846d5412e0c4&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:25.141425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.170126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956583e6-2dd2-4fbb-9278-ea9392444c43 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.171735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.207154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.214720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a526b-aade-492d-9946-418a877106e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.215398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a526b-aade-492d-9946-418a877106e1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.215702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a526b-aade-492d-9946-418a877106e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.215953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a526b-aade-492d-9946-418a877106e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.223757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a526b-aade-492d-9946-418a877106e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.225503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a526b-aade-492d-9946-418a877106e1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-134a526b-aade-492d-9946-418a877106e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:25.239241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:25.240226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:25.241122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:25.245350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 344/678] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:25.246873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.247157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.247434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.269604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:25.270830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:25.298549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e725686-66d2-46f4-8c37-14d3049ce4c3 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.340693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.341563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.342215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.342215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.343239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.343239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.345151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.353174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 345/679] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:25.354358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.363063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 335/680] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:25.369107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.452143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.486242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8cd7a-faaa-4783-afa2-cc1a8abac51f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.498213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d7c1-590d-47e2-9c42-bffe6f099cb4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.525100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.525861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.526269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.526620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.535054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.553954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.554825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.555604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.556037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.556472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.557343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.558160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.560117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.561145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.586582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 346/681] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:25.591579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:25.592783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:25.593995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:25.593995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:25.593995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:25.593995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 336/682] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:25.595249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.598337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.713960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab8ec6-95da-49ea-ab1b-3dcfabe69bac None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.761414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb54b1-6b0f-495a-8b52-45d88efc2660 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.762550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.763609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.764887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.765344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.766226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=f7a7f863bc194cefaec8d5fb79c670fc) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.766677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.768261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.776958 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 347/683] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/role_assignments?user.id=f7a7f863bc194cefaec8d5fb79c670fc&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:25.785520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.811660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.851544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.852368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.852753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.853130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.853959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.854377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.855898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.857233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.892986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 337/684] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:25.898630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.927230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aeb40f-346a-4b2c-b005-822f37fb1cb4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.976947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.977835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.977950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.978184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.992335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.994253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:26.011817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:26.012761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:26.014308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:26.014308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:26.014308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:26.014308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 348/685] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:26.018749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.062085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ff8b-c342-4bde-ab36-20b7d6fc2fcd None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.105740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.106764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.107259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.107783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.117376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.119106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.133385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:26.133717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:26.134686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:26.135638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:26.137166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d31c-1ebb-4164-b16c-6f79a4cc0100 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.138726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 338/686] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:26.146204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.186471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.187354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.187807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.188271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.189116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.189594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.191107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.214628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 349/687] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:26.224675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.244108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.358220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb7af1-4e58-406f-9acd-7cff06b5d310 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.415911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe84247-6331-4984-a474-056a60a22f73 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.431752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.432762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.433249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.433752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.434702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.435231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.436945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.462040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c56e9-6e8e-461f-9496-dc1ad434cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.463029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c56e9-6e8e-461f-9496-dc1ad434cbd1 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.463515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c56e9-6e8e-461f-9496-dc1ad434cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.464014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c56e9-6e8e-461f-9496-dc1ad434cbd1 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.464870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c56e9-6e8e-461f-9496-dc1ad434cbd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.466605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c56e9-6e8e-461f-9496-dc1ad434cbd1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.479543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 339/688] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:26.485609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.507824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 350/689] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:26 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:26.650366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fec6c-cda4-4b3d-bda3-f75255b1da13 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.654414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.700048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.700925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.701407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.701822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.775511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.777657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.848332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2d1c-6d83-4dd6-b96f-51d32d26b5ae None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.849191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2d1c-6d83-4dd6-b96f-51d32d26b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.849688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2d1c-6d83-4dd6-b96f-51d32d26b5ae None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.852899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 351/690] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:26.859220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.864180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.864180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.884364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:26.884558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 340/691] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:26.885687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:26.891413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.894413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.897290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.969939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 352/692] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:27.008876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352d8a-8478-485f-9542-588e49d69d2f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.043986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.044850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.045327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.045753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.056174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.057818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:27.072874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:27.074144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:27.075302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:27.075302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:27.075302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:27.076957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 341/693] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:27.082706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.193881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60dd10-a4e3-4829-b9b4-24f20397b0dc None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.236799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.237755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.238227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.238682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.239544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:27.240050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.242229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.260162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 353/694] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:27.265859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.289345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.293780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.349660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.384499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc2a6-7563-43e0-a5f1-3734e82183c7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.423942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.424581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.424862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.425137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.444262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.445971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.448108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512ebe4-fe0f-42a1-b9db-17a8dd8734eb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:27.478113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:27.479098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:27.480010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 342/695] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:27.485243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.488619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.489612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.490134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.490629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.510329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:27.516383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:27.517368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:27.518222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:27.527989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 354/696] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:27.529215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.624281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282b11f-9caa-48d0-a3e6-16009492fb2e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.631110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.643751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.665448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.666846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.667322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.667899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.668857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:27.669603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.671936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbaa8c-c250-4eea-b87c-8c0615449aac None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.680426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329bc0b-6071-46c2-88d3-a07a78da7724 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.696472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 343/697] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:27.697603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea659d-dc09-4c6c-b482-9ce1aa13233d None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.697891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea659d-dc09-4c6c-b482-9ce1aa13233d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.698167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea659d-dc09-4c6c-b482-9ce1aa13233d None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.699587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 344/698] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:27.701642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea659d-dc09-4c6c-b482-9ce1aa13233d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.733852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.734912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.735444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.735972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.736948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:27.737587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.739461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d750046-5d2c-433d-aab6-cbfad3914f94 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.749928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 355/699] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:27.751487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.751967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.752418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.773011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:27.774634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:27.813315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea659d-dc09-4c6c-b482-9ce1aa13233d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.848776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.849502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.849852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.850208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.851041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=b2f9c8b7933e4742a5023154e9fd2218) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:27.851393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.852879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.861673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 356/701] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:27.862919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.865435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 345/701] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/role_assignments?user.id=b2f9c8b7933e4742a5023154e9fd2218&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:27.967608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.000843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd62f-c116-4c82-8563-adacc741eb9f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.037662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.038371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.039184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.039461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.050498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.051935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:28.067407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:28.068413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:28.069377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:28.069377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:28.069377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:28.069377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 357/702] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:28.075755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.123630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.184325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a3c29-c885-4ce1-9245-b4f5aaa5899e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.219690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.220324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.220605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.220880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.221453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.221901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:28.221901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.223210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703ce5-647f-4cda-a45b-4e75b9c0ab3a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.239698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 346/703] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:28.245250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15860b-e7ac-47f2-b6ef-7787f45cf964 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.245559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15860b-e7ac-47f2-b6ef-7787f45cf964 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.245839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15860b-e7ac-47f2-b6ef-7787f45cf964 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.247349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 347/704] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:28.248080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15860b-e7ac-47f2-b6ef-7787f45cf964 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.355106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb648a2d-028a-44d9-9b66-a04cf60a53bb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.363308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.366728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.369299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15860b-e7ac-47f2-b6ef-7787f45cf964 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.400202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.400853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.401139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.401452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] PATH_INFO: `/v3/services/network` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.402289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.403924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.412546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.413506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.413983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.414449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ca00b955-efee-4ad9-a3e8-c26ede55e141 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:28.418494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:28.419539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:28.420424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:28.424431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 358/705] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:28.426187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.427009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.427283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.427544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.429092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:28.446579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:28.447534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:28.448476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:28.450615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:28.450807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 348/706] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:28.451811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.452069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:28.531501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 359/707] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:28.532649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.612591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e447c-d59b-4fec-8161-03f0a7310df7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.655361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6622e3-f5d1-4f58-b861-7a1a55d9cf8f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.661853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.692715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.693846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.696236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.696688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.697510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] RBAC: Adding query filter params (name=network) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:28.698951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.700474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.711311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 349/708] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:28.716487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.746667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.753977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.754606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.754892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.755173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.755917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:28.756210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.758246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.805717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 360/709] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:28.818260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.839940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b9c39-ea08-4797-93ab-ea5f0ef55773 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.875400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:28.875931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.876211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.876484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.877105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:28.877438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:28.878798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:28.885227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 350/710] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:28.886087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:28.957648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b72a8b-4002-44a3-9761-83f5a6b7cda6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:28.988891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.999903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8bff-31eb-4b0e-9d39-eb59b30d845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.000920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8bff-31eb-4b0e-9d39-eb59b30d845a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.001449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8bff-31eb-4b0e-9d39-eb59b30d845a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.001967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8bff-31eb-4b0e-9d39-eb59b30d845a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.002546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56f33-05f5-4415-9aef-ce8a274e1fc5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.035962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.039807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.040457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.040736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.041004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.041624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.043006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:29.054866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:29.055981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:29.056821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 351/711] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:29.064662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.135383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8bff-31eb-4b0e-9d39-eb59b30d845a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.139437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8bff-31eb-4b0e-9d39-eb59b30d845a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.199852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860ad7c-10bb-46bf-9248-1c72e15a486c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.238330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.239136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.239505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.239873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.240603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:29.241050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.242581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0091c04-cec5-4c23-a536-f686ecf9e4c0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.247588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 352/712] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:29.248858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c991-5047-458d-823a-8f360d8017c1 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.253601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c991-5047-458d-823a-8f360d8017c1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.253995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c991-5047-458d-823a-8f360d8017c1 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.255698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 353/713] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:29.256544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c991-5047-458d-823a-8f360d8017c1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.258186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 361/714] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:29.264412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.264873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.265320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.277714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.287116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:29.288575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:29.365563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.378320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c991-5047-458d-823a-8f360d8017c1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.379360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 362/715] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:29.380296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.417778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.418720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.419215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.419700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.420527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:29.421038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.422608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.427938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 354/716] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:29.550758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed9847-35c7-4ee5-803d-8478d9456067 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.590671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.591770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.592305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.592803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.605381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.607184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:29.622631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:29.623590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:29.624569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:29.624569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:29.624569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:29.626585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 363/717] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:29.632304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.719687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.736257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.745903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5946b6-2144-44f2-bc15-602f4aec98c1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.805435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.806346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.808400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.808400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.808400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.808400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:29.808400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.809760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.835565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 355/718] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:29.841492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.912046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb854b-adcc-4d51-a5c4-da4c07f09ce9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.979742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.980373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.980655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.980921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.996586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:30.005908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1c567-4362-499d-a764-f34a7e6c9d6d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:30.009157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:30.010153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:30.011022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:30.011668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 364/719] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:30.022160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.071511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.072147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.072423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.072694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.083374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.084811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.096826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:30.109848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:30.110770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:30.111660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:30.112545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 356/720] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:30.119723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.199405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45895697-500f-474e-ad16-9723b3e80c6f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.200945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.277833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.278620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.279311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.279597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.280545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.280852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.283187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f8ca-e95a-4ea5-9a8e-6b57b7d652df None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.284842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee840ab-770b-4633-b569-e4ac202176cc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.294262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 365/721] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.296022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f23fb-be67-4ab7-88b6-1239af9914af None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.296696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f23fb-be67-4ab7-88b6-1239af9914af None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.296976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f23fb-be67-4ab7-88b6-1239af9914af None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.301380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 366/722] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:30.302247 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f23fb-be67-4ab7-88b6-1239af9914af None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.327666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.328288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.328569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.328848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.329582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.329903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.331446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c6927-04cd-4e64-867a-a9857b036177 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.351772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 357/723] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:30.353757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.354211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.354657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.374375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:30.375580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:30.437951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.441406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f23fb-be67-4ab7-88b6-1239af9914af None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.457469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 358/724] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:30.458333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.483665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.484990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.485555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.486242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.498636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.500349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:30.517751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:30.518713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:30.519636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:30.519636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:30.519636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:30.521992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 367/725] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:30.532847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.560288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.657060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38f53-3cc1-4545-beca-e7a99e3f1e95 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.731639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a8bc-dcb3-48c9-85de-46421456dae5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.814278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.814808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.815086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.815355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.816065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.816364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.817753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.826683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.827291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.827566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.827833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.828549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8324e7cb70744038987b7d15f002160f) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.828848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.830271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.842691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 368/726] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:30.843546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.845125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 359/727] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/role_assignments?user.id=8324e7cb70744038987b7d15f002160f&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:30.851760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.936351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.963895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092a285-ec97-46eb-b794-03a81bef4e0d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.004858 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.005528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.005805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.006074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.019257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.031554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:31.036889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:31.037874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:31.038758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 369/728] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:31.045753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.106791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff913c-b460-43ab-b79c-24070d890c4a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.162925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.163594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.163870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.164138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.171922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.173377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-194a2c7c-eda1-4494-a2a7-4270e6a33627 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:31.186364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:31.187325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:31.188285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 360/729] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:31.188885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8d4e-842e-4bcc-8ef9-def287c19459 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.193367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8d4e-842e-4bcc-8ef9-def287c19459 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.193367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8d4e-842e-4bcc-8ef9-def287c19459 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.193367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 361/730] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:31.194340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8d4e-842e-4bcc-8ef9-def287c19459 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.212548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8611-c1fa-4aa1-948e-bacdaab34741 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.248069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.248997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.249519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.250032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.250869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:31.251370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.252997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af841360-505b-4314-aec9-ef2dbdf0640a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.255566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.267725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 370/731] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:31.269488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.269982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.270455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.290230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:31.292112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:31.308433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8d4e-842e-4bcc-8ef9-def287c19459 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.325027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.348779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.349464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.349745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.350010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.351404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:31.351707 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.353181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.381414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 362/732] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:31.381414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.381645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 371/733] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:31.381645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.489010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187546e-3848-4741-b2ae-ae2931bfa5ca None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.525118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.525775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.526051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.526322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.536729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.538762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:31.553593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:31.555220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:31.556129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:31.556129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:31.556129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:31.556129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 363/734] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:31.562475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.570066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62595ee-418e-4bb3-a8f0-29d96762646e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.591889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.649698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.672608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ec725-aca5-460e-899c-bea0275267e8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.677942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.678567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.678882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.679694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.708116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.708818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.709097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.709393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.710026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:31.710859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.712209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.724815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 364/735] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:31.732109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.787017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.788721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.828667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.846287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def29fc-9a54-4d1b-a5ac-c811c8e1237f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.885919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.887055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.887902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.888488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.899373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 372/736] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:31.899373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.899587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.899587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-5cd24a72-0553-4f29-b9f6-173fcd398a13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:31.911957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:31.912893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 365/737] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeefd-9284-44de-a5d7-a2da2232c4bb None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.914696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeefd-9284-44de-a5d7-a2da2232c4bb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.915434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeefd-9284-44de-a5d7-a2da2232c4bb None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.920015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 366/738] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:31.920015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeefd-9284-44de-a5d7-a2da2232c4bb None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.931225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.008067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7155f9-f4dd-4aa2-8ea5-3caadea57dd8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.025971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeefd-9284-44de-a5d7-a2da2232c4bb None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.043564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164df4-7916-40de-bb74-df521493f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.044170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164df4-7916-40de-bb74-df521493f455 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.044453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164df4-7916-40de-bb74-df521493f455 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.044729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164df4-7916-40de-bb74-df521493f455 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.045398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01164df4-7916-40de-bb74-df521493f455 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.046753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01164df4-7916-40de-bb74-df521493f455 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.063263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.064000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.064284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 373/739] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:31 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:32.065081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164df4-7916-40de-bb74-df521493f455 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.073491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.074237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.092517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.094837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-64869d89-feb7-40e7-8c84-59a40758324f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:32.118733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:32.119830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:32.120746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:32.120746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:32.120746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:32.122658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 367/740] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:32.123174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.125858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.126309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.126816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.156128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:32.157923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:32.181460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.205330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164df4-7916-40de-bb74-df521493f455 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.250826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 368/741] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:32 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:32.251687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.251817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.252317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.252599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.252874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.253638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:32.253965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.255392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.275501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 374/742] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:32.281242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.412932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3581-f725-4cca-81fa-815509c82819 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.430830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2378d-099e-45f3-968c-63b568c7179e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.457886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.475146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.475817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.476595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.476863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.477986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.478583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.478853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.479179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.479822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:32.480118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.481873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.504768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.505408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 369/743] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:32.510521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.617531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.621557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.640481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefda79-b183-4ea0-a001-84c207c87f7f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.678417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.679947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.680552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.681040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.688968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.690862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:32.703452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:32.704461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:32.705399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:32.707945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 370/744] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:32.708920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.734613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 375/745] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:32.739327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.766520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.782117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:32.825895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843f388-19bd-4546-97cc-0a65c4c17d2d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.839609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ffa-5477-4bf5-9f69-9cc54c34a209 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:32.862844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.864104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.864665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.865155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.866043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.868183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.875072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:32.875833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.876143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.876457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.877823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:32.878952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:32.880871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:32.893727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 371/746] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:32 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:32.895100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:32.899722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 376/747] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:32.900812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.012658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8add2-7187-4c90-a980-5610128ec8b7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.020710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.060029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.060818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.061161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.061526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.062358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=2ed3ba8987a04008a337de0a7955237e) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:33.062723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.064210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b371f73-215e-40d8-b40d-0a5d4a8d67a5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.071559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09006037-e162-48cc-9af5-db8446bce618 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.072179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 377/748] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/role_assignments?user.id=2ed3ba8987a04008a337de0a7955237e&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:33.073629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3765b9-d828-4e04-91cd-2a4a13754e29 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.073976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3765b9-d828-4e04-91cd-2a4a13754e29 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.074312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3765b9-d828-4e04-91cd-2a4a13754e29 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.080154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 378/749] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:33.082246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.082531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.082808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.089663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.106093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:33.107510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:33.168697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.169406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.169687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.170006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.184423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.186111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.197939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 379/750] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:33.208506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:33.209786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:33.210976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:33.210976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:33.210976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:33.216007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 372/751] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:33.217240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.329681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.341517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab5081-e523-49e5-8877-a4728f667354 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.398890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.399499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.399773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.400039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.400730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:33.401030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.402415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.416466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 380/752] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:33.422385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.542157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.577448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f2eb-7676-4a52-bc43-c35f7a066e53 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.627723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.628271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.628547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.628815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.636607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.638719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:33.651427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:33.652375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:33.653324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 373/753] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:33.660177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.689671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.740254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0490-70b6-48eb-9b2d-93ff2a1fdc05 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.776350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.777226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.777543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.777807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.788989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:33.794176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:33.795326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:33.796377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 381/754] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:33.801233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.837616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.858712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8eece-612e-4cfd-b518-8dba09eef9b0 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.904628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c978b69-828a-4603-be17-48869c4a6042 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.942222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.942924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.943274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.943616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.944340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:33.944783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.946305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.949949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.950575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.950858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.951135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.951888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:33.952199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.953638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.959773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 382/755] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:33.961624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.991540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 374/756] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:34.002243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.044058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:34.082861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5343c4-7594-4a45-bde2-e2ccfb552137 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.124575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:34.158336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.159274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.159735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.160195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.167585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf9834-cace-4217-a294-731ec782a2b7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.198138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.199833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.214252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.215173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.215634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.216108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.217013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=b2f9c8b7933e4742a5023154e9fd2218) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:34.217522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.220222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55909b-b32e-470c-9e32-dc6d1ff8c3ce None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:34.229339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:34.230281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:34.231192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:34.231192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:34.231192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:34.235649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 383/757] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:34.236009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 375/758] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:34 2022] GET /identity/v3/role_assignments?user.id=b2f9c8b7933e4742a5023154e9fd2218&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:34.240782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.250971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f747e35-ab16-40d0-8624-d06be0e8a6ff None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.251294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f747e35-ab16-40d0-8624-d06be0e8a6ff None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.253111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f747e35-ab16-40d0-8624-d06be0e8a6ff None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.253342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 376/759] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:34.258791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.259124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.259346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.281955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:34.283193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:34.401651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 377/760] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:34.442115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d87bd4-5ed0-4e16-93e7-75f886af19e3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.472681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:34.484035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.484884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.485499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.485942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.486844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:34.487291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.488849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.501739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 384/761] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:34.510397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.596765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:34.637006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254e585-fbf3-4968-a474-2c2e72d6ac87 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.683819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.684693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.685148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.685715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.698595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.700262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:34.713575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:34.714724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:34.715982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 378/762] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:34.721623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.826935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.889482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c260-6928-4134-907f-50a0301b7758 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.950077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.951044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.951525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.952001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.952978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:34.953524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.956817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.997768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 385/763] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:35.006684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.043217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f14969-577c-4a80-8ab2-2b0ce19e6f7b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.075824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.119656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44978bf-fc54-4051-9f82-7e0535383b96 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.150335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.158745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.159656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.160051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.160423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.170516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.171355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.171477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.171878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.172310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] PATH_INFO: `/v3/services/network` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.173053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.173282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.174708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:35.189272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:35.190471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:35.191401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:35.191401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:35.191401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:35.197193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 386/764] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:35.198390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:35.202756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:35.203804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:35.204659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:35.215305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 379/765] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:34 2022] GET /identity/v3/services/network => generated 88 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:35.230502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.311879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae049f35-e491-47db-8b7d-77e5f8978adf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.314902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.365715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.367253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.367748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.368539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.369764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:35.370639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.372083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3a8e9-3cfa-4ca9-b574-0cb8c951cb00 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.389727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 387/766] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:35.391071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dda52-8f35-4581-b195-71d19eb6eda4 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.391357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dda52-8f35-4581-b195-71d19eb6eda4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.391634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dda52-8f35-4581-b195-71d19eb6eda4 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.392881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 388/767] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:35.394198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dda52-8f35-4581-b195-71d19eb6eda4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.426852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a606-81c1-4ecb-8590-e0a6019bca6c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.466534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.467571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.468109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.468589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.469544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:35.470088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.471710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5e2e-58d6-4f4f-bd37-7e20e979e6a4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.477396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 380/768] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:35.478876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250fd0-b61f-41b4-8d18-0776c7f97cb6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.479365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250fd0-b61f-41b4-8d18-0776c7f97cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.479860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250fd0-b61f-41b4-8d18-0776c7f97cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.500924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-44250fd0-b61f-41b4-8d18-0776c7f97cb6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:35.502531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-44250fd0-b61f-41b4-8d18-0776c7f97cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:35.513167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dda52-8f35-4581-b195-71d19eb6eda4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.549581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.550215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.550496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.550865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.558665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.560130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.563608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:35.572693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:35.573834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:35.574987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:35.578337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 389/769] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:35.579021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 381/770] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:35.579189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.580515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4323-eb7e-4d8f-821a-800a2192212a None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.580806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4323-eb7e-4d8f-821a-800a2192212a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.581080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4323-eb7e-4d8f-821a-800a2192212a None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.582467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 382/771] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:35.586924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4323-eb7e-4d8f-821a-800a2192212a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.604134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.696295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2569e-ad63-4c11-be60-956f2c4162a6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.721874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4323-eb7e-4d8f-821a-800a2192212a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.731605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.732752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.733178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.733632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.734524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] RBAC: Adding query filter params (type=network) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:35.735004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.736585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb74a-fe59-441f-b975-ae73cfaf5182 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.748474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 390/772] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:35.750184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.750793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.751260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.761982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.762598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.762878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.763153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.763843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:35.764272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.765600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.775182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:35.776767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:35.783972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 383/773] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:35.783972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.847137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.861501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 391/774] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:35.862656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:35.881911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:35.922217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e67f3-6589-4167-8a8d-3d48aebfd884 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:35.965553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:35.971168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:35.971542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:35.971939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:35.972663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] RBAC: Adding query filter params (interface=public, service_id=702b8854b61a48eca431364250084ba6, region_id=RegionOne) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:35.973042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:35.978056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:35.992502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 384/775] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/endpoints?service_id=702b8854b61a48eca431364250084ba6&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:35.992502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.100429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acfb8-7a2c-431d-9c8d-da7aec005167 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.160701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.161403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.161741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.162027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8324e7cb70744038987b7d15f002160f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.162313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8fd4-cfdb-4e9f-816e-d5f5dd31dbf5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.163987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=8324e7cb70744038987b7d15f002160f, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.165457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.180151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.186283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 392/776] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:35 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8324e7cb70744038987b7d15f002160f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:36.193521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.241877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.242511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.242988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.243669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.246302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.248745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:36.268669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:36.269973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:36.271022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:36.278732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 385/777] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 24 07:45:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:36.279870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.339930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.386570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f78fa-9aac-4189-a159-916e64fb189b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.418258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf352-5213-4c57-bb75-71262b87a3fe None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.424116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.424719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.424995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.425405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.430606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.435708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.445322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 393/778] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:36.445322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.467034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8efb4b-c142-4fbd-9e2b-20728dcb2b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.467738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8efb4b-c142-4fbd-9e2b-20728dcb2b74 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.468022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8efb4b-c142-4fbd-9e2b-20728dcb2b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.468293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8efb4b-c142-4fbd-9e2b-20728dcb2b74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.481199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8efb4b-c142-4fbd-9e2b-20728dcb2b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-ed8efb4b-c142-4fbd-9e2b-20728dcb2b74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:36.486170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:36.487151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:36.487988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:36.492457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 386/779] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:36.493875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951287-a952-4316-a948-f3fa11a270a0 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.494166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951287-a952-4316-a948-f3fa11a270a0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.494445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951287-a952-4316-a948-f3fa11a270a0 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.496160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 387/780] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:36.496952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951287-a952-4316-a948-f3fa11a270a0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.546124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.560871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14946-5d5e-475a-a610-1fad0adfa2fe None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.599711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.600319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.600619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.601443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.602067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:36.602365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.603716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5987219-fec6-4073-957c-5e891599d8d6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.604857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.609888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 394/781] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:36.611093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.611375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.611645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.628078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951287-a952-4316-a948-f3fa11a270a0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.631521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:36.632736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:36.676451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.677549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.678028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.678546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.680030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:36.681125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.683102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.695346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 388/782] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:36.696318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.715155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 395/783] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:36.716007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.832329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c262-712b-4b8c-9748-4bf55e57cc85 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.885864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.896172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.901852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedae53-00d9-4cd8-a972-4d92f897f17a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.902631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.903270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.905026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.905301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.924704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.926187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:36.953115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:36.954322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:36.955442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:36.955442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:36.955442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:36.958999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 396/784] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:36.960787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.977083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.978000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.978425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.978840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.979613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:36.980060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.981703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.987348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 389/785] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:36.994308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.073698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a374-b7ef-4a78-bfdf-9e8dac4f6078 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.113672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.114200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.114479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.114751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.115391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:37.115690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.118673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.144568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 397/786] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:37.145715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.172965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1262-72b9-4496-b013-173189bb1b07 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.192165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.212914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.214019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.214495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.214913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.215752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] RBAC: Adding query filter params (interface=public, service_id=937fc03e4e4a41b090328e1e2f5692d5, region_id=RegionOne) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:37.216230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.217901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.223985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 390/787] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/endpoints?service_id=937fc03e4e4a41b090328e1e2f5692d5&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:37.224967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.253637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6264-a865-4102-b43d-96e37f1cbbe6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.256468 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.289853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.290519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.290805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.291081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.301583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:37.306899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:37.308005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:37.309007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 398/788] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:37.314614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.354001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db69cd4-98c8-43fa-9c1d-3637e6c295dc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.392133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.393088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.393579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.394056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.402877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.404591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.414305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.417387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4ee5a-dbea-4c6c-ac0b-453282544413 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:37.419620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:37.420711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:37.421800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:37.424476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 391/789] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:37.425433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.461592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.462354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.462695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.463037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.463710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.465128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.470942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 399/790] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:37.471607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.530453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.546411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028e5f-551d-4e92-b441-0403d5a0f558 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.582097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceedaf5-e992-4c17-ab6e-fa62aae5a543 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.586775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.587583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.588013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.588448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.589532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:37.590176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.592005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.603793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 392/791] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:37.609880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.621906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.622626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.622977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.623321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.624222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:37.624555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.626086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.650681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 400/792] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:37.652524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.682366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.762377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224c303-c033-4db4-a5aa-c467029cc18e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.768719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344172b-c810-45d7-9d1f-f6ee403e49da None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.801754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.802749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.803125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.803499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.814145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.815996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.822902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.823817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.824264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.824682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:37.831898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:37.833496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:37.834613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:37.834613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:37.834613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:37.840093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.840352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 401/793] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:37.841985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:37.842266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:37.858244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:37.859283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:37.860338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:37.860338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:37.860338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:37.862237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 393/794] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:37.868328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:37.871421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.928068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.955395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1bf2f-43c7-404e-bad0-8f3dfd01354b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.983512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508d68b-f253-4a45-9631-2d036e612a01 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:37.993821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:37.994594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:37.994974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:37.995352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:37.996094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:37.996604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:37.998033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.017244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 402/795] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:38.018438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.022861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.023684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.024111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.024527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.025334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:38.025773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.027291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.045502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 394/796] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:38.047156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.115120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.127451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2212-80d7-42d6-b6db-e4d69eb0b65d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:38.158793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c28b-ebbc-4a25-9c1a-3c1a0fb0a6e6 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:38.163644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.164393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.164775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.165147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.167346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.173947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.175545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:38.188351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:38.189563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:38.190543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:38.195600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 403/797] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:38.196852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.202751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.203970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.204422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.204874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.213387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.215143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:38.228536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:38.229532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:38.230493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:38.233028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 395/798] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:38.238872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.305652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d22dc-2480-497d-b42b-c35a3d3a22d8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:38.353216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.354336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.354767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.355187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.355582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa73ef1-3b2b-4087-99e6-593d0e923179 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:38.356240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:38.356688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.359463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009415-aa75-4cd8-91fb-759aad754eb5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.381046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 404/799] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:38.381046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9885-6a3f-4748-92fb-1ff6a9bbeb21 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.381046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9885-6a3f-4748-92fb-1ff6a9bbeb21 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.381046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9885-6a3f-4748-92fb-1ff6a9bbeb21 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.386475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 405/800] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:38.387225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab9885-6a3f-4748-92fb-1ff6a9bbeb21 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.389542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.409069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.410043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.410595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.411110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.412206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:38.412694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.414370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cb27-0783-4362-8540-6386313f1871 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.434239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 396/801] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:38.435883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.436351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.436828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.454966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.458591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:38.460481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:38.507980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab9885-6a3f-4748-92fb-1ff6a9bbeb21 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:38.541744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 397/802] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:38.542890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.696031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97c072-3d10-4b7c-9644-5f5ba7c800ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.697549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97c072-3d10-4b7c-9644-5f5ba7c800ef None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.697847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97c072-3d10-4b7c-9644-5f5ba7c800ef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.698124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97c072-3d10-4b7c-9644-5f5ba7c800ef None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/2ed3ba8987a04008a337de0a7955237e/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.701030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365f80-e224-4531-89b0-7bf194e87c9a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:38.713444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.723219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97c072-3d10-4b7c-9644-5f5ba7c800ef None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=2ed3ba8987a04008a337de0a7955237e, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.724677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97c072-3d10-4b7c-9644-5f5ba7c800ef None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.738991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:38.739633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.739921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.740281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.740560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 406/803] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:38 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/2ed3ba8987a04008a337de0a7955237e/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:38.742035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214186-0003-43c8-91fa-53fa90249cd4 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.742147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214186-0003-43c8-91fa-53fa90249cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.742682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214186-0003-43c8-91fa-53fa90249cd4 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.744626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 407/804] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:38.750951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.751572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.752049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.761426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:38.761426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:38.794896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:38.796133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:38.800578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:38.801607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:38.803273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:38.803273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:38.803273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:38.803273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 398/805] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:38.807986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.921057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 408/806] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:38.921958 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:38.961177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.971465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ab71-ae26-4209-a9d6-e8e7bc569d6f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.008753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.009414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.009698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.009972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.010620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:39.010925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.012296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.025984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 399/807] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:39.031534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.057289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.064325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214e5dd-b9d2-46d4-bda7-b69b8836425b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.135083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.135757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.136039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.136314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.154298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:39.159718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:39.160624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:39.161508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:39.164406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 409/808] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:39.174024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689768-1e0d-4aae-9b89-750234cbe5c9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.174493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.226090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.226825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.227383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.228108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.240064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.242341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:39.265573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:39.266675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:39.267768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:39.273396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 400/809] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:39.274425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.318340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.327911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b27e-9a93-4397-99b9-eef0046305fa None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.370971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.372057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.372484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.372917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.373766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.375615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:39.376066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.379057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.391086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 410/810] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.392512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.395128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961c57-70ee-44a0-be1d-c0a244864d96 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.433979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.434856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.435238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.435618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] PATH_INFO: `/v3/services/network` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.436405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.437901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:39.448413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:39.449685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:39.450521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 401/811] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:39.451344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.501634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bcc52-3901-49eb-a0f8-51e57d235cac None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.539228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.540179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.540649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.541098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.541981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:39.542470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.544088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.556391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 411/812] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.557585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.571024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd73bc-478a-442a-bb37-cd0e897c361a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.577550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.611316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.612050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.612396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.612739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.624338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.625936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.634128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:39.644201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:39.645184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:39.646113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:39.646113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:39.646113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:39.651324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 402/813] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:39.652225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.666696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829bf51-6f8d-4577-94b8-1cdc1a8d2ee3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.702499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.704461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.704739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.705007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.705735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] RBAC: Adding query filter params (name=network) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:39.706037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.707400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.714978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 412/814] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.715800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.780067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6565c-454b-468b-b23c-173a90965278 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.802657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.824001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.824505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8368-f50b-4399-9435-c135ba4ba53f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.825062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.825517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.825935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/b2f9c8b7933e4742a5023154e9fd2218/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.829084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=b2f9c8b7933e4742a5023154e9fd2218, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.830693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.848417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 403/815] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:39 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/b2f9c8b7933e4742a5023154e9fd2218/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:39.849604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.878737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.879511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.879942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.880316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.881078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:39.881568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.883662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.923614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 413/816] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.926490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.930448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.975630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c99f6-b2e1-4350-8a62-41de724238f4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.019555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.020466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.021198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.023275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.024149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:40.024636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.026671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.035949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 404/817] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:40.042364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.079461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9cf2b-fa94-4cbc-97c1-e7704d170faf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.119476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.120103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.120403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.120641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.130949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.133017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.137393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-064ce630-31c2-4d23-8263-34e4102f72a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:40.150300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:40.151307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 414/818] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:40.152890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b9bd-79d7-425e-aed3-3a22a581e4f5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.153637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b9bd-79d7-425e-aed3-3a22a581e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.153637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b9bd-79d7-425e-aed3-3a22a581e4f5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.158919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 415/819] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:40.158919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9b9bd-79d7-425e-aed3-3a22a581e4f5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.185370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd78993-0477-4504-b350-099ef69b91b4 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.214258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:40.230726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dbace-b615-4427-aff2-e2e2786b73ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.232633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbace-b615-4427-aff2-e2e2786b73ee None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.233080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbace-b615-4427-aff2-e2e2786b73ee None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.233801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbace-b615-4427-aff2-e2e2786b73ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.234608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dbace-b615-4427-aff2-e2e2786b73ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.237037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dbace-b615-4427-aff2-e2e2786b73ee None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.270938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 405/820] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:40.273406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.273855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.274736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.291631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9b9bd-79d7-425e-aed3-3a22a581e4f5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.300950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:40.303187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:40.332586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.333432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.333825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.334192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.335098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:40.335469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.337037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.363959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 416/821] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:40.370158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.409288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 406/822] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:40.467816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:40.531172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca85bb3-0b86-4e78-abb9-7db4dbe74c4e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.566622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.567293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.567666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.568033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.643848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.645531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.706051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:40.758839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 417/823] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:40.761029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.767538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.891015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6608c-7803-437b-94eb-24633a4ef1fc None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.899684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f9fa7-822e-46e8-b6b9-d071b578ffed None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:40.911522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:40.936228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.936865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.937138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.937490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.943305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:40.944229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:40.945414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:40.945884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:40.946695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.948371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.949223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.950954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:40.958152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:40.959126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:45:40.959994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:40.962735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 407/824] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 24 07:45:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:40.971097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:40.972186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:40.973093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:40.973093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:40.973093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:40.973093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 418/825] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:40.973351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.973439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:40.984795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.078181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989e31-0eab-4687-a4fc-0b1b3fad34c3 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.087689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e91d37-67d7-4832-bb36-691208044e45 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.113638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.114253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.114533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.114812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.115432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:41.115733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.117681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373cdc-0e60-4162-bca6-a0daa86d308e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.122786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 408/826] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 07:45:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:41.124447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410101c-283b-4073-8753-a213632990cd None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.124941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410101c-283b-4073-8753-a213632990cd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.125445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410101c-283b-4073-8753-a213632990cd None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.127314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 409/827] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:41.128776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410101c-283b-4073-8753-a213632990cd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.134962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.135646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.135926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.136198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.136896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:41.137221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.138687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b2aa-aa88-49da-b22e-162c61480b6b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.156698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 419/828] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:41.156698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.156698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.156698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.174573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:41.175768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:41.177321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.243811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.248741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410101c-283b-4073-8753-a213632990cd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.252351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 420/829] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:41.253157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.304998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.305969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.306466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.307420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.308517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:41.309019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.311528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.318683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 410/830] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:41.324210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.365408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7ad8-a9ff-491b-a925-fb165f8d0f84 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.410959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.411782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.412065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.412334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.421358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.423297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.433379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.436892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236fe88-666b-4ef3-9b5c-897d017f6fe3 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:41.440060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:41.440951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:41.442303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 421/831] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:41.450200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.482187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.483091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.483604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.484055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.484909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.486680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.517379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 411/832] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:41.527932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.541788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.576805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe77c30-612e-4d3c-93a4-69ed91e4bab0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.622472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.623081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.623357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.623623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.624304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:41.624602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.626166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.640633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 422/833] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:41.646901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.661552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff02582-15a1-4c28-bf0f-8a1ccc37cb21 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.700822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.701593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.701877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.702247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.715708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:41.722555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:41.723493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:45:41.724325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:41.729479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 412/834] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:41.730496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.760604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.766879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2322-01c4-4273-a390-f34c150ebcd0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.783959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.817712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.818322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.818602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.818874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.820145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8324e7cb70744038987b7d15f002160f) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:41.820450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.821905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.830272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 423/835] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/role_assignments?user.id=8324e7cb70744038987b7d15f002160f&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:41.856708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5b29-d8cf-4fb7-8c39-2f0c0a1f31d2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:41.897072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:41.897806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.898577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.898852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.899525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:41.899826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:41.901289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151894c-c4c4-49c6-972a-a579eb5dc0cb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:41.911709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 413/836] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:41.917563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:41.980269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247160b7-ddaa-4500-80ad-36c036b27672 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.980602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247160b7-ddaa-4500-80ad-36c036b27672 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.980825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247160b7-ddaa-4500-80ad-36c036b27672 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.982492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 414/837] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:41.988575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.988857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.989138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.010788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:42.011996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:42.039609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448503b-0e86-4b53-ab25-be5b9bf1e51b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.082214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.082848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.083125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.083452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.092702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 415/838] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:42.097794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.099236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:42.116507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:42.117620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:42.118542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:42.118542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:42.118542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:42.118542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 424/839] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:42.125062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.138654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.235138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d76c0-90bb-4dd9-9579-a6f59ca113e7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.273802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.274419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.274675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.274954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.275596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:42.275897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.277272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.289599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 416/840] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:42.294839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.327110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.359507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.422662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5885-773d-4e8d-8889-dfbb442bc933 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.434805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.470019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.471448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.472008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.472444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.473539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07254-74db-438f-a7ef-67fe33d46c9a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.482031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.483466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:42.495511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:42.496686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:42.497965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:42.501313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 425/841] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:42.502585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.520735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.522320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.522753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.523176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.534426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:42.539882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:42.541054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:42.541998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:42.544403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 417/842] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:42.550818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.615041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.631137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2d1f-5d5c-4369-8439-4655f5b908d8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.668691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.669599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.670027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.670459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.671234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8029d2-e5b0-4645-96db-7f22d4d1d863 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.671528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:42.671988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.673852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.693512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 426/843] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:42.699477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.707151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.717429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.718222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.718696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.719129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.719931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:42.720396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.721936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.731026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 418/844] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:42.738913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.822092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e12506-fab0-4f28-9492-7c3ec6703508 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.858143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.858979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.859403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.859818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.869177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad8fc-64ea-487b-b53f-4e09940957a7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.876363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.922966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.923591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.923867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.924137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.938188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.939629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.940339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.943120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:42.962638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:42.963822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:42.964921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:42.964921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:42.964921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:42.967052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 419/845] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:42.972737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.033650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.053329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 427/846] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:45:43.058530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.110713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ae50c-cc99-4960-a691-7638c3b8b3ce None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.123209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.148775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.149913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.150465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.151013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.151848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:43.152387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.154095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.173520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 420/847] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:43.174746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.191049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b62f-73ab-4f22-b7f6-91284ee11b54 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.237437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.238070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.238348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.238620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.253516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.254957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:43.275175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:43.276184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:43.277108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:43.277108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:43.277108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:43.281303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 428/848] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:43.282809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.291172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b2bb-420a-4789-b527-d08230415a5c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.293673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.339927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.340286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.340561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.340839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.349883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.352782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:43.372322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:43.373520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:45:43.374675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:43.377690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 421/849] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:43.383072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.421294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.427170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1a6d-98c8-44c3-b87d-5fd7503b3989 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.477970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.478584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.478868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.479142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.480349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:43.480707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.482146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.501382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 429/850] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:43.504988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.514934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0b16-0aaa-49b9-b14c-17981093853a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.559581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.560193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.560471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.560742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.561948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:43.562263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.563692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759c04b-f2d9-4225-86fb-094b40e42343 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.589421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 422/851] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:43.591771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3849eb-0996-44dc-b6d5-5a421028d086 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.592243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3849eb-0996-44dc-b6d5-5a421028d086 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.592706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3849eb-0996-44dc-b6d5-5a421028d086 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.594697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 423/852] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:43.595641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3849eb-0996-44dc-b6d5-5a421028d086 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.619154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.640564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece35a3-1551-4035-acf3-391a4aea2d14 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.678430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.679606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.679884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.680152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.687217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.688716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-189bd027-fc9d-40e4-be92-42f3ff2746be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:43.700690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:43.701658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:43.702546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 430/853] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:43.703035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.703113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.703646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.709904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3849eb-0996-44dc-b6d5-5a421028d086 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.721239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:43.722442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:43.738618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.749699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5045-71e2-489e-b367-3bb43edf5226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.750316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5045-71e2-489e-b367-3bb43edf5226 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.750598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5045-71e2-489e-b367-3bb43edf5226 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.750877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5045-71e2-489e-b367-3bb43edf5226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.796280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 431/854] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:43.797358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.836951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5045-71e2-489e-b367-3bb43edf5226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.838732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5045-71e2-489e-b367-3bb43edf5226 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.869675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:43.927538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829093-f60d-42ba-b180-ef9334d39af5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:43.964817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:43.965456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.965740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.966017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.966702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:43.967011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:43.968430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959661b-c391-412c-90dc-ad247fc4e8bd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:43.974214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 424/855] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:43.974214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c573-1e38-4375-bfe9-7be5d63a135e None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.974214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c573-1e38-4375-bfe9-7be5d63a135e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.974214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c573-1e38-4375-bfe9-7be5d63a135e None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:43.974214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 425/856] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:43.977508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c573-1e38-4375-bfe9-7be5d63a135e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:43.990679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 432/857] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:43.992475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:43.992764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:43.993040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.011777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:44.012953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:44.014874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.086206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 433/858] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:44.087135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.092258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c573-1e38-4375-bfe9-7be5d63a135e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.113790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.131522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.132256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.132540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.132814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.143010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.144447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:44.159211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:44.160163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:44.161065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:44.161065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:44.161065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:44.161065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 426/859] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:44.161065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.209108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e78-0e41-4b33-bf12-d92200372468 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.245512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.246116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.246395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.246662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.247377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=2ed3ba8987a04008a337de0a7955237e) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:44.247685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.249087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.265296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 434/860] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/role_assignments?user.id=2ed3ba8987a04008a337de0a7955237e&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:44.265296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.268524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.280191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180374e-88b4-4f6f-acf9-cca6706c95cc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.319521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.320584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.322333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.322640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.323256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.324670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:44.341073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:44.342146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:44.342996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 427/861] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:44.354323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.394065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac1841-f2fe-4ca2-be9a-46bd33b1dc4b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.397599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.437168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.437820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.438882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.439168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.439995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:44.440115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.441580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.455359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 435/862] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:44.455724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.471157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a75110-48f8-4932-a53d-95c2000e5f27 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.512179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.513174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.513687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.513964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.514596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:44.514902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.516271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.522891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 428/863] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:44.527462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.529417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.570906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19e48-3210-429e-921f-86f657055a69 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.608943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.609625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.609908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.610180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.610755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.612112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:44.621924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:44.622877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:44.623773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 436/864] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:44.624580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.639729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.642691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcb52b-3921-4737-8558-80bd9ce418d2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.678110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.679284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.679677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.679951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.687313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.688861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:44.701382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:44.702285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 429/865] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:44.708131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.734621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22878b36-c9f6-4cc6-a65b-0ad20751ef2f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.761017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.771030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.771901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.772176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.773148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.773628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:44.773941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.775288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.779852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 437/866] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:44.780619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.829336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f343d8-ece9-4b3a-b6ba-eb3293435c4f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.868387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.869014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.869330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.869611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.870250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:44.870555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.871939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.877482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 430/867] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:44.883573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:44.916813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:44.924133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc248b-9c56-458b-9fe7-2be182b1a31d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:44.963422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:44.964209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.964580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.964982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.965788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:44.966160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:44.967655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:44.981474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 438/868] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:44.987338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:45.013561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a0ff-9e20-4d37-9629-eee0a7a99854 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.044244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:45.061664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.062279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.062561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.062835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.063466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:45.063765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:45.066075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b585073-5a09-4610-b5e4-55b00806b632 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:45.072609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 431/869] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:45.105586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69e5a-891e-407a-a2ba-558725831bd5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.145381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.146008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.146286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.146810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.147613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=b2f9c8b7933e4742a5023154e9fd2218) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:45.147918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:45.149415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c3271-e3a9-4d8d-b8f3-b4f2fbb9e5bb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:45.156748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 439/870] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:44 2022] GET /identity/v3/role_assignments?user.id=b2f9c8b7933e4742a5023154e9fd2218&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:46.280417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6d9c-c2a3-4ea4-aa5c-39934e0c8975 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:46.281122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6d9c-c2a3-4ea4-aa5c-39934e0c8975 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:46.281122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d6d9c-c2a3-4ea4-aa5c-39934e0c8975 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:46.282612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 432/871] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:46.288680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab7fd-f85f-4930-a51b-153f4ce13b6e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:46.289152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab7fd-f85f-4930-a51b-153f4ce13b6e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:46.289334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab7fd-f85f-4930-a51b-153f4ce13b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:46.307665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3c2ab7fd-f85f-4930-a51b-153f4ce13b6e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:46.308853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3c2ab7fd-f85f-4930-a51b-153f4ce13b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:46.390799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 440/872] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:46.661858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d6d9c-c2a3-4ea4-aa5c-39934e0c8975 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:46.726104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa389-bcbb-40bb-979e-777599267cdd None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:46.726759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa389-bcbb-40bb-979e-777599267cdd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:46.727234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa389-bcbb-40bb-979e-777599267cdd None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:46.728982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 441/873] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:46.734203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:46.734713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:46.735197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:46.754928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:46.755770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:46.758198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:46.769700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d6d9c-c2a3-4ea4-aa5c-39934e0c8975 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:46.805398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:46.813293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:46.814315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:46.814611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:46.814937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:46.829665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:46.834974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:46.835893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:46.836746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:46.839318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 433/875] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:46.844047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 442/875] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:46.845120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:46.950524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a288a-6b9e-4922-ad60-a9d141de4b53 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:46.985765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:46.986369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:46.986642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:46.986904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:46.987551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:46.987847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:46.989200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f841f-c63f-4bf8-9c90-d88f6baeb694 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:46.998054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 443/876] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:47.003606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.030133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce869-e821-4764-891b-40c79ca50150 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.030426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce869-e821-4764-891b-40c79ca50150 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.030697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce869-e821-4764-891b-40c79ca50150 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.032280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 444/877] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:47.037120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.037439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.037731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.056019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:47.057232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:47.093403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:47.120818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314676f8-3b4b-4f48-9d72-830008f2d989 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.151953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 445/878] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:47.152766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.164690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.165466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.165753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.166041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.176190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.177645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.187635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-053ec337-9dda-466f-b901-3e8c7b93a5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:47.195073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:47.196057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:47.196959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:47.196959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:47.196959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:47.204423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 434/879] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:47.205605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734249a3-0ce5-4bb2-b055-48fb5d2c9ff3 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.205883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734249a3-0ce5-4bb2-b055-48fb5d2c9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.206153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734249a3-0ce5-4bb2-b055-48fb5d2c9ff3 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.207507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 435/880] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:47.208039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734249a3-0ce5-4bb2-b055-48fb5d2c9ff3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.265732 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eae05-25b9-4b35-868c-eea7aedaf80d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.305625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d3879-80c5-42e7-922c-549323a66858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.306256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d3879-80c5-42e7-922c-549323a66858 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.306601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d3879-80c5-42e7-922c-549323a66858 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.306834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d3879-80c5-42e7-922c-549323a66858 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.307512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d3879-80c5-42e7-922c-549323a66858 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.308869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d3879-80c5-42e7-922c-549323a66858 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.317837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734249a3-0ce5-4bb2-b055-48fb5d2c9ff3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.323808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 446/881] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:47 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:47.324920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.325210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.325809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.359086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:47.361490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:47.382318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.382943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.383219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.383545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.384642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:47.384642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.386178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.393538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:47.405597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 436/882] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:47.414502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.462122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 447/883] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:47.462315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.491092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:47.548949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f01fb6-1fc4-4090-af1a-c6a291fb44fc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.590529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eef9f1-3ab9-44dc-9950-092ec3800e1d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.602704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.603790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.604144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.604492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.614391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.616705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.626936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.627542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.627823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.628094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.628732 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:47.629477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:47.630469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:47.631408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:47.632522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.632596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 437/884] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:47.638933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.655259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 448/885] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:47 2022] POST /identity/v3/services => generated 269 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:47.734261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.764453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a74d8-ea5b-4c78-be1f-2b21be87c7e1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.772752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:47.788220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:47.818799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.820213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.820637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.821077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.822046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:47.822638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.824212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.848332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 438/886] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:47.854037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.867865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236fc73-cc64-47d2-96e3-1387f41e7e26 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:47.905186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:47.905898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.906369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.906489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.907064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:47.908420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:47.918488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:47.919523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:47.920373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 449/887] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:47.925748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:47.973750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0730-1c41-420a-b594-892da9ed5e74 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.011597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.012502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.013032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.013554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.032974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.057808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a9828-8969-4bd7-9dc4-51dceea40f95 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.060487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.095063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.096950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.103186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.103795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.104126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.104404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.105026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:48.105352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.107296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.114151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 450/888] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:48.119058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.206950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 439/889] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:47 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:45:48.212629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.250428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9305d70-bf0f-47e9-b4ec-b1ebab6093ea None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.294688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.304433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.305827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.307115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.307876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.308729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:48.309502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.311851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.318559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 451/890] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:48.333395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36689da2-4485-4ae0-aa58-4bb01739016f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.373157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.373833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.374109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.374378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.387619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.389149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:48.405873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:48.406892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:48.408441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:48.408441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:48.408441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:48.408441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 440/891] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:48.412700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.425730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.525302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33b31b-659e-491e-9c52-eef3e3ca8bdf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.561557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.562089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.562370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.562641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.563278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:48.563578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.564931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.577559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 452/892] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:48.583045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.686712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5833c-9490-40ff-b6bb-db4c421842e2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.709314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.724165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.724799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.725074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.725921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.732828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.734279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:48.746047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:48.746957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:48.748473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 441/893] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:48.752882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.825822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.864988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b0796-ca9a-49da-84ff-01c29c1a12c0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.901158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.902115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.902598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.903051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.903946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:48.904511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.906126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699b07-05a2-4666-a434-5a170a48b104 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.923784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 453/894] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:48.925396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:49.030998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895976-85c5-484a-93e8-03c43e0f77ff None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:49.066162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:49.067116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:49.067659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:49.068178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:49.069158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] RBAC: Adding query filter params (role.id=7e6f74fc579f48c7946d0a66ec5ac774, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=2ed3ba8987a04008a337de0a7955237e) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:49.069664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:49.071257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58623e54-7dd8-4233-bc4a-a4a3c95ae5bb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:49.081430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 442/895] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/role_assignments?user.id=2ed3ba8987a04008a337de0a7955237e&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=7e6f74fc579f48c7946d0a66ec5ac774 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:49.363682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081167f-d5ca-4a5b-8acc-23c680200b74 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:49.364187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081167f-d5ca-4a5b-8acc-23c680200b74 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:49.364266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081167f-d5ca-4a5b-8acc-23c680200b74 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:49.365607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 454/896] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:49.371219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b2ac-23f7-4294-b560-95d994823894 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:49.371674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b2ac-23f7-4294-b560-95d994823894 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:49.371752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b2ac-23f7-4294-b560-95d994823894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:49.390476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0b89b2ac-23f7-4294-b560-95d994823894 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:49.391677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0b89b2ac-23f7-4294-b560-95d994823894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:49.435300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:49.465605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 443/897] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:49.710368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44cd2b-c9ff-4bc5-8c2e-ab3590dc22c5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:49.710776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44cd2b-c9ff-4bc5-8c2e-ab3590dc22c5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:49.710956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44cd2b-c9ff-4bc5-8c2e-ab3590dc22c5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:49.712479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 455/898] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:49.717678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:49.717966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:49.718245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:49.735218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44cd2b-c9ff-4bc5-8c2e-ab3590dc22c5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:49.737461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:49.738776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:49.825340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 444/899] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:49.846211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44cd2b-c9ff-4bc5-8c2e-ab3590dc22c5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:49.873404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:49.882156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:49.882772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:49.883048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:49.883317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:49.883886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:49.885233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:49.893843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:49.894815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:49.895665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 456/900] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:49.903355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.010230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b163bf-ae03-42c3-abe9-90ad5ca0f515 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.018190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:50.047653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.048624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.049138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.049643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.050475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:50.050999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.052563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.057977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 445/901] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:50.066304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.107077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.175510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732962a7-dc63-48c0-8991-c344f3150d02 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.212430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.213035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.213336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.213608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.214227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:50.214522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.215931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.221767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 457/902] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:50.227365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.241398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327a07e-7718-4082-8483-80ef67cce431 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.292435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.293508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:50.295299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.296120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.297381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.298733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.301385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:50.313116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:50.314109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:50.316077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:50.325467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 446/903] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:50.327932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.346162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb18325-6085-4763-bf9b-567665a978cb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.369330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:50.382348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.382963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.383246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.383519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.384245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] RBAC: Adding query filter params (interface=public, service_id=89cd9abe163548ed9bf6d2d5cb98c011, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:50.384509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.385896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35d76a-d90e-4b83-99ec-ba188491e317 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.393594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 458/904] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/endpoints?service_id=89cd9abe163548ed9bf6d2d5cb98c011&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:50.399196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c3e2-c25b-4a1c-8ed7-0c1c6c46cc64 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.399649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c3e2-c25b-4a1c-8ed7-0c1c6c46cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.399931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c3e2-c25b-4a1c-8ed7-0c1c6c46cc64 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.401292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 459/905] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:50.405835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c3e2-c25b-4a1c-8ed7-0c1c6c46cc64 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.444938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21267b4-5489-488e-ac7b-7ad1e1a7abef None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.481687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.482615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.483116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.483619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.484458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:50.484961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.486604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf8233-ecf2-4df9-a555-02f79b0d2cbd None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.495996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 447/906] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:50.495996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.495996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.495996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.512236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:50.513659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:50.517554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c3e2-c25b-4a1c-8ed7-0c1c6c46cc64 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.538440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:50.552828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.553485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.553770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.554041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.554670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.556109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.562118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 460/907] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:50.562894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.605327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 448/908] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:50.691292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05672148-ed78-4709-b3be-7991f86dd2b5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.732918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.733563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.733842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.734109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.734731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:50.735030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.736379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.742074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 461/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:50.747945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.778193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:50.855730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11f35-3230-4c74-8799-13c694711ec2 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:50.879971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.892638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:50.893254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.893555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.894007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.894528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] RBAC: Adding query filter params (interface=public, service_id=48beb1f9a936464e8b619cb61b83bc5b, region_id=RegionOne) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:50.894839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:50.896195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:50.902299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 449/910] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/endpoints?service_id=48beb1f9a936464e8b619cb61b83bc5b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:50.908034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:50.951657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:51.011517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:51.022877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef2d8-9067-4895-8205-242be615a159 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.024167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fda44-6bc9-4bda-b094-494573ae3671 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.062140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30e3dc-3a7f-4f6f-835f-e26cd7ad6f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.062352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.062746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.062850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30e3dc-3a7f-4f6f-835f-e26cd7ad6f46 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.063026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.063122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30e3dc-3a7f-4f6f-835f-e26cd7ad6f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.063286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.063379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30e3dc-3a7f-4f6f-835f-e26cd7ad6f46 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.063915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:51.064027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30e3dc-3a7f-4f6f-835f-e26cd7ad6f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:51.065286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:51.065384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30e3dc-3a7f-4f6f-835f-e26cd7ad6f46 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:51.071845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 450/911] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:50 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:51.073040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2a2a-0d76-409a-80ec-676d7ef815aa None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.073384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2a2a-0d76-409a-80ec-676d7ef815aa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.073733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2a2a-0d76-409a-80ec-676d7ef815aa None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.075052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 451/912] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:51.080839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.081153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.081469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.095061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 462/913] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:50 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:51.106523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:51.108414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:51.203997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 452/914] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:51.473788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:51.582443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e394ed-275e-40fb-a2ff-7cc11422d8ec None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.591938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:51.621313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.621954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.622237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.622513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.633278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:51.638681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:51.639611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:51.640832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 463/915] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:51.646058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:51.733493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:51.755057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547cb92-302d-43e9-a4dd-8dd1df75dc23 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.792419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.793405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.793915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.794391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.795246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:51.795748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:51.797312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:51.806617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 453/916] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:51.811834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:51.915527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135c1a0-ed64-418a-bdd8-481cb699ea27 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.950375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.951004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.951288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.951562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.962932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:51.964493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:51.979572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:51.980568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:51.981890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:51.981890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:51.981890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:51.981890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 464/917] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:51.986837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.092879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd40d27-eab7-4c51-8384-9da0a9bdd521 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:52.128084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:52.128701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.128980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.129255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.129919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:52.130223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:52.132140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:52.144845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 454/918] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:52.150842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.175182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:52.260928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d14a9-fc70-4e2e-a31c-bf57bf002539 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:52.298201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:52.298914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.299197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.299469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.308213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:52.309745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:52.321625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:52.322563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:52.324208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 465/919] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:52.328718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.332668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:52.435933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904444ac-2edc-42c3-b66f-d7897acb1a3b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:52.470073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:52.470694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.470975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.471246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.472038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:52.472409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:52.473921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff50d-ab7a-46fa-a03c-66c0abdd90c7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:52.493955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 455/920] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:52.499507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.511312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdf3f-fb1d-410d-a223-866e7ae06c13 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.511551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdf3f-fb1d-410d-a223-866e7ae06c13 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.511798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdf3f-fb1d-410d-a223-866e7ae06c13 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.513386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 456/921] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:52.518237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.518523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.518797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.536855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:52.538696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:52.597884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:52.599616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:52.617625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 457/922] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:52.620518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d5912-d81c-40b9-99f4-7cc8e47d9dd1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:52.656534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:52.657165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.657477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.657748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.669210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:52.670679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:52.685652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:52.688004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:52.690230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:52.690230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:52.690230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:52.690230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 466/923] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:52.692855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.797120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6015-65e4-42a9-aeeb-6e6f4bdb01bc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:52.831490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:52.832103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:52.832386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:52.832659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:52.833324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:52.833636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:52.835587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:52.847563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 458/924] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:52.853730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.893654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:52.951355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:52.973625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d081-89b7-4c45-8daa-004eda3cdbfb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.005348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf632d-42b5-4c19-8038-eed3868efc14 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.014646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.022575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.023725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.024157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.024735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.034543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.036795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.042769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.043400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.043674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.043940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.044508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.045879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:53.051624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:53.052682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:53.054284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:53.055358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:53.056301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:53.057245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:53.063485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 459/926] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:53.063657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 467/926] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:53.064562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.064795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.177207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3247b-502d-4e62-a44b-82f0d7563be1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.184463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4747eb-a46b-43c4-a6e9-e68ea5104b07 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.195400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.212976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.213603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.213879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.214147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.214827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:53.215127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.216542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005c074-f89a-47b7-adaf-d8676f1d24c6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.218084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081620e-1106-48da-8352-421b25c5635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.218697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081620e-1106-48da-8352-421b25c5635f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.218978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081620e-1106-48da-8352-421b25c5635f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.219255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081620e-1106-48da-8352-421b25c5635f None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.219878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081620e-1106-48da-8352-421b25c5635f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:53.220182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081620e-1106-48da-8352-421b25c5635f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.221570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081620e-1106-48da-8352-421b25c5635f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.226661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 468/927] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:53.227794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9372a-7688-404c-a7f8-887fc815c28d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.228080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9372a-7688-404c-a7f8-887fc815c28d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.228355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9372a-7688-404c-a7f8-887fc815c28d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.229489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 460/928] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:53.230722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35116cf5-1f85-4c7f-9519-0b1d19d3e5c5 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.231014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35116cf5-1f85-4c7f-9519-0b1d19d3e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.231379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35116cf5-1f85-4c7f-9519-0b1d19d3e5c5 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.232574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 461/929] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:53.233378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35116cf5-1f85-4c7f-9519-0b1d19d3e5c5 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.236093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 469/930] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:53.236976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9372a-7688-404c-a7f8-887fc815c28d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.295356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.335265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35116cf5-1f85-4c7f-9519-0b1d19d3e5c5 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.340609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9372a-7688-404c-a7f8-887fc815c28d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.369997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.370598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.370877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.371146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.371760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:53.372051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.373432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118c736-eead-4464-8948-fbf4ba60a1a7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.375356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb409dcd-0542-44a9-a87c-70b448e0736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.376006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb409dcd-0542-44a9-a87c-70b448e0736c None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.376287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb409dcd-0542-44a9-a87c-70b448e0736c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.376560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb409dcd-0542-44a9-a87c-70b448e0736c None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/2ed3ba8987a04008a337de0a7955237e/roles/7e6f74fc579f48c7946d0a66ec5ac774` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.378246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 462/931] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:53.378724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb409dcd-0542-44a9-a87c-70b448e0736c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=2ed3ba8987a04008a337de0a7955237e, role_id=7e6f74fc579f48c7946d0a66ec5ac774)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.379353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.379631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.379902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.380128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb409dcd-0542-44a9-a87c-70b448e0736c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.395036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 470/932] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:53 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/2ed3ba8987a04008a337de0a7955237e/roles/7e6f74fc579f48c7946d0a66ec5ac774 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:53.396542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.397164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.397576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.398302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:53.399510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:53.417034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:53.418340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:53.442361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.483852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 463/933] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:53.484712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.517708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 471/934] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:53.599305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f09a7-a15e-4dd3-8b8b-7afc7e4967a9 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.637198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.637852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.638134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.638411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.639078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.640445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.664597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 464/935] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:53.755491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.782476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.808521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.824813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.871799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4ed33-9703-4d25-8006-2f5b515a6868 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.923377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.924022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.924457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.924869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.925478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.925991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd062c4-672f-44de-8640-d3f9112ddb53 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.926848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:53.943279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:53.944795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:53.945712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 472/936] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:53.952530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.968760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.969452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.969781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.970060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.970727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:53.972349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:53.982633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:53.984860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:53.986644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 465/937] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:53.993295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.060124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013777f-e1c1-4a4b-b25b-1ee2c8c34203 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.085648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.086314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.098676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.099465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.099919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.100325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.101153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.101590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.103201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.104369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3e42-ae18-4aa5-bbbd-994bb6aeec3f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.109204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 473/938] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:54.114411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.140931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.141909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.142381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.142835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.143690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.144235 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.145817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.152122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 466/939] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:54.157455 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.222177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2191-73b3-44eb-a1b6-3e5ee0aa6900 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.259166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.259882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.260319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.260665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.261491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.261861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.263291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.263886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9abc5-a7ec-47f3-b703-622138becdb2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.268919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 474/940] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:54.274354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.298443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.299057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.299337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.299609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.300238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.300538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.301940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.312353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 467/941] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:54.313193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.313823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.341067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.398658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb69cc-a215-4a00-8ae4-02cc604ada57 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.439381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.440608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.441329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.442124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.443262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.445514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.450301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4f3ac-8b56-48c2-a866-cd0474ce18ba None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.474929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 475/942] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:54.501663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.502714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.503176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.503646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.504553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] RBAC: Adding query filter params (interface=public, service_id=e74a8a16ec0b410bb61295871ceb233e, region_id=RegionOne) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.505046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.506762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c2bd-5f3c-4c09-be9b-d7b7db0cc3cf None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.513519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 468/943] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/endpoints?service_id=e74a8a16ec0b410bb61295871ceb233e&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:54.519516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.624538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.637497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b9b2a-8d4d-4ffe-b861-a332452299c8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.679025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd915-8713-4559-8999-0d5b28fd3968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.679910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd915-8713-4559-8999-0d5b28fd3968 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.680328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd915-8713-4559-8999-0d5b28fd3968 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.680739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd915-8713-4559-8999-0d5b28fd3968 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.681532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dd915-8713-4559-8999-0d5b28fd3968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.683011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dd915-8713-4559-8999-0d5b28fd3968 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.689437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 476/944] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:55.407399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7067-3100-419e-9d8a-b0766fc58c0b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:55.407932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7067-3100-419e-9d8a-b0766fc58c0b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:55.407932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7067-3100-419e-9d8a-b0766fc58c0b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:55.409581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 469/945] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:55.415640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20932268-56f9-4dd7-bb4c-553609ef79c0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:55.415932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20932268-56f9-4dd7-bb4c-553609ef79c0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:55.416210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20932268-56f9-4dd7-bb4c-553609ef79c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:55.434999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-20932268-56f9-4dd7-bb4c-553609ef79c0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:55.436180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-20932268-56f9-4dd7-bb4c-553609ef79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:55.505958 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 477/946] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:55.684747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de9033-7ab9-4a72-b94e-53bce9e56d35 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:55.685128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de9033-7ab9-4a72-b94e-53bce9e56d35 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:55.685347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de9033-7ab9-4a72-b94e-53bce9e56d35 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:55.686914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 470/947] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:55.692216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:55.692673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:55.692753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:55.711875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:55.713063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:55.780038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de9033-7ab9-4a72-b94e-53bce9e56d35 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:55.784353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 478/948] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:55.861792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:55.889743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de9033-7ab9-4a72-b94e-53bce9e56d35 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:55.924109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:55.924744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:55.925025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:55.925319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:55.936534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:55.941105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:55.942057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:55.943457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 471/949] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:55.951029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:55.969621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.058243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf13401-fd46-4ed6-94e7-b80c1df0733f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.065486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.101802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.103072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.103962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.104710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.105646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:56.106184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.108875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.124679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 479/950] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:56.127015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.195400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d93fa-c06c-46ec-bcca-97a99314fc13 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.231186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.242999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.243640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.243931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.244205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.244855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.246811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.251511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING keystone.server.flask.common [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 07:45:56.255471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.267467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf84d-4ba8-4989-8e53-c40cb9a5a306 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.276807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.sql.core [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:45:56.276807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:45:56.276807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [parameters: {'id': 'a665dd5b3dba4c82b01da0b21aaf64e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:45:56.276807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81532) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a665dd5b3dba4c82b01da0b21aaf64e9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a665dd5b3dba4c82b01da0b21aaf64e9. Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:56.287335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 07:45:56.288727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application yield resource Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise self.value Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application session.commit() Aug 24 07:45:56.290276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:45:56.291413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:45:56.292531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:56.293487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [parameters: {'id': 'a665dd5b3dba4c82b01da0b21aaf64e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.294520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:56.295361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a665dd5b3dba4c82b01da0b21aaf64e9. Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 472/951] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 24 07:45:56 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:56.296498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.322490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.323492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.323954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.324426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.336174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.338101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:56.357811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:56.358785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:56.359738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:56.359738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:56.359738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:56.366865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 480/952] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:56.368713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.422515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd5e3-7f45-45cf-872b-e4612250036f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.460254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.461312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.461806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.462285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.470078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.472293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-7605eace-09d0-4f9a-b0ea-dea289e0733b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:56.485476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:56.486507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:56.487475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:56.489889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 473/953] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:56.491978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ca4c-da5e-4ca4-a47b-814e43bc0e8d None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.492260 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ca4c-da5e-4ca4-a47b-814e43bc0e8d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.492530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ca4c-da5e-4ca4-a47b-814e43bc0e8d None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.496818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 474/954] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:56.497474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ca4c-da5e-4ca4-a47b-814e43bc0e8d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.507752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998130c-0e4d-4abe-97df-0dc8025cafdb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.539313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.548019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.548615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.548887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.549155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.549809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:56.550100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.551448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66464b-c589-42de-b99e-9adb6761b9b9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.554189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.565474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 481/955] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:56.566910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.567192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.567455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.585753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:56.587046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:56.621920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ca4c-da5e-4ca4-a47b-814e43bc0e8d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.659457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.660154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.660503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.660839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.665406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 482/956] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:56.665573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:56.665573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.665766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.665861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4e09e-7f14-49c9-9cf3-cadd27c7d9a1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.696088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 475/957] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:56.714790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ee00-b8e3-4ebf-9721-a56b4076e452 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.714992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ee00-b8e3-4ebf-9721-a56b4076e452 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.715255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ee00-b8e3-4ebf-9721-a56b4076e452 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.716895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 476/958] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:56.722533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.722817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.723094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.742993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:56.744548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:56.802209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb7b64-ff24-4e66-ba38-492dd2a9c26b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:56.823408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.844947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:56.845613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.845894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.846164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.848050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 477/959] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:56.856762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:56.858503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:56.871050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:56.872032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:56.873077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:56.876382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 483/960] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:56.880311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:56.929477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:56.943894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.010446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a07c2-efd5-4e8c-bdff-1a72c5d03bd2 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.058413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.059029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.059138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a3cc9-ace4-4127-9682-3ff2da824b47 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.059358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.059616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.060342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.060995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.063380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.089366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 478/961] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.091937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.102129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.102768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.103049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.103320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.104092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.105393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:57.114783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:57.116547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:57.117464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.121093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 484/962] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:57.122203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.172240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.203438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.207515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752fc72-e442-4d88-ae4b-1d5aa9c5e942 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.233982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62d34b-afd0-4267-834c-8f06b7117e56 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.242749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.243355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.243639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.243905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.273166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.273752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.274037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.274292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.274868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.276224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:57.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:57.286072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.287546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 485/963] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:57.288579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.321225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.322668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.404117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b943-51d2-4370-b106-3ca2baea53ec None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.411485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.432862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.437993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 479/964] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:57.438869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.449332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.450289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.450771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.451340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.452166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.452542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.454047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.464228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 486/965] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.464965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.541559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f4ec-83fc-466d-b6bb-b0cc2626cb4b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.567407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ce47-0c6a-48fa-8934-4555b5e15821 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.583838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.585599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.586097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.586571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.587401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.588366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.590442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.596977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 480/966] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.598258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.602137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.602771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.603239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.603521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.615646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.617851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:57.632776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:57.633788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:57.634697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:57.634697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:57.634697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:57.634697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 487/967] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:57.634697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.660226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.676568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.720087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549dbaa-30d4-4ab0-b288-30c8b3fbab28 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.740845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969e824-deb5-4466-9433-309ba76a873c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.756801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.757439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.757721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.757996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.758630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.758934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.760288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.773306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 481/968] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.773306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.785761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.786476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.786826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.787287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.788587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.788955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.790401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.796452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 488/969] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.802507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.888771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82706-dd95-4b67-8416-f326509a015e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.912271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.926372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.933284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34bd05-ecc8-4c5f-b5ea-e88b6c012b90 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.939454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.940354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.940819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.941758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.942637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.943139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.945431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.961560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 482/970] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.967085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.977560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.978203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.980013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.980013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.980013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.980741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:58.003553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 489/971] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:58.084293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf721d7-2c35-4480-9218-1cc395c06db5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:58.134888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:58.135950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:58.136491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:58.136973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:58.145428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:58.147572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:58.161518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:58.162540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:58.163463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:58.165993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 483/972] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:58.172375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:58.282685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d57ef1-8d47-49fa-a5d2-e9757a7000a1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:58.317478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:58.318085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:58.318368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:58.318634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:58.319848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:58.320144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:58.321581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04fbf9-deb2-41b2-9ed4-807f87cc770e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:58.335436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 490/973] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:58.341070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:58.392327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:58.458283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f076-4732-414a-8cda-70dab76acdf1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:58.494522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:58.495132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:58.495417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:58.495693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:58.496414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] RBAC: Adding query filter params (role.id=7e6f74fc579f48c7946d0a66ec5ac774, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=2ed3ba8987a04008a337de0a7955237e) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:58.496722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:58.498227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fe8f-7aab-4868-94c1-e31e0942cbc8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:58.504586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 484/974] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:58 2022] GET /identity/v3/role_assignments?user.id=2ed3ba8987a04008a337de0a7955237e&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=7e6f74fc579f48c7946d0a66ec5ac774 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:58.773529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c3ab-38fe-4edc-bdad-23976fa06a1e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:58.774119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c3ab-38fe-4edc-bdad-23976fa06a1e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:58.774585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c3ab-38fe-4edc-bdad-23976fa06a1e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:58.776390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 491/975] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:58.782427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:58.782715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:58.782989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:58.801078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:58.802311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:58.871335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 485/976] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:59.147958 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c3ab-38fe-4edc-bdad-23976fa06a1e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:59.150874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:59.259367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c3ab-38fe-4edc-bdad-23976fa06a1e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:59.295915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:59.296521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.296852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.297131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.297843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:59.299262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:59.301875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING keystone.server.flask.common [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 07:45:59.314440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.sql.core [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:45:59.314440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:45:59.314440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [parameters: {'user_id': 'f3fba1ebb0544f1a9e0df13ff62b8575', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:45:59.314440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81533) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:59.331671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:59.333830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application yield resource Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise self.value Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application session.commit() Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:45:59.336699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:45:59.338979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:59.349398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:59.351278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f3fba1ebb0544f1a9e0df13ff62b8575', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:59.352395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 07:45:59.353500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:45:59.354726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 492/977] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 07:45:59 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:59.355221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:59.388471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:59.457322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f6404-61ac-4937-afc1-cd3da66dd4b5 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:59.491919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:59.492648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.492869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.493198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.500668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:59.502221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b4230cc5-69a4-4fe0-8cee-7da962cd2b41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:59.518584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:59.520862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:45:59.523563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 486/978] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:59.529287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:59.593719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:59.635072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08fc4-ddce-4218-b0a9-efd8fcfc123c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:59.673894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:59.675407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.675687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.675957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.676665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:59.676968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:59.678679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5b881-b8d1-4aae-8ca5-759621dcfea0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:59.718107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 493/979] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 07:45:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:59.815567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b5f3-888a-44b8-858e-18bd34d37af1 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.815910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b5f3-888a-44b8-858e-18bd34d37af1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.816155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b5f3-888a-44b8-858e-18bd34d37af1 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.817872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 487/980] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:59.824400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0886-688f-488f-9da8-a20d47cb5e8e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.824705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0886-688f-488f-9da8-a20d47cb5e8e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.824971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0886-688f-488f-9da8-a20d47cb5e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.844761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-e2ca0886-688f-488f-9da8-a20d47cb5e8e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:59.846387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e2ca0886-688f-488f-9da8-a20d47cb5e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:59.919832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 494/981] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:00.113614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2211e-7859-48ff-97ce-8cda6cdb0196 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.113954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2211e-7859-48ff-97ce-8cda6cdb0196 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.114134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2211e-7859-48ff-97ce-8cda6cdb0196 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.116295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 488/982] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:00.121163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.121489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.121765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.139495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:00.140680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:00.189641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.190815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2211e-7859-48ff-97ce-8cda6cdb0196 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.211118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 495/983] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:00.291658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.299350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2211e-7859-48ff-97ce-8cda6cdb0196 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.333164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a49d6-54c7-48b7-a909-a4fa7468084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.334026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a49d6-54c7-48b7-a909-a4fa7468084c None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.334971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a49d6-54c7-48b7-a909-a4fa7468084c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.335387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a49d6-54c7-48b7-a909-a4fa7468084c None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.336170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a49d6-54c7-48b7-a909-a4fa7468084c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.337733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a49d6-54c7-48b7-a909-a4fa7468084c None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.357305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 489/984] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:46:00 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:46:00.486250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.510865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3161e5-7e48-43c8-a620-a2e50f7d1b54 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.511396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3161e5-7e48-43c8-a620-a2e50f7d1b54 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.511396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3161e5-7e48-43c8-a620-a2e50f7d1b54 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.512971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 490/985] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:00.518256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.518543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.518814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.538505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:00.539695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:00.594523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3038dc-0e76-4bc7-b2cd-a0f491fe9d5a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.616882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 491/986] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:00.636030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.636982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.637526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.638011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.638804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.640371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:00.650564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:00.651539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:46:00.652403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:00.654247 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 496/987] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:00.660263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.744594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.764606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e2ac7-78a5-43cc-9128-1c6cfbf2cb24 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.799711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.800316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.800590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.800856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.801495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:00.801793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.803148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.808187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 492/988] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:00.813635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.865638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.887641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.922028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8e89-637a-495a-bb82-15d93811d8e0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.960027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.960631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.961101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.961415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.962039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:00.962342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.963698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.970067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 497/989] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:00.975524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.994100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93839b-3232-411b-91ff-d4762d497ce7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:01.028536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:01.029085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:01.029391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:01.029661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] PATH_INFO: `/v3/services/image` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:01.030228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:01.031578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:01.040948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:01.042183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:01.043049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 493/990] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:01.047814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:01.060813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:01.083005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b4548-04c0-4bd9-a7aa-785ccfb9f047 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:01.094689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:01.120003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:01.120606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:01.120888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:01.121164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:01.121895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] RBAC: Adding query filter params (interface=admin, service_id=e74a8a16ec0b410bb61295871ceb233e, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:01.122204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:01.123553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:01.128863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 498/991] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/endpoints?service_id=e74a8a16ec0b410bb61295871ceb233e&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:01.134291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:01.166413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e499f2-7dd1-477d-8704-5400a733007b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:01.200796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:01.201453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:01.201733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:01.202005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:01.202619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] RBAC: Adding query filter params (name=image) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:01.202916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:01.204267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:01.209034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 494/992] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:01.214956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:01.240753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878be90-b11f-4511-bed8-de4afd32e5cb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:01.275465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf3fa2-3937-4900-bb59-1b46f59bbd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:01.276073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3fa2-3937-4900-bb59-1b46f59bbd74 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:01.276355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3fa2-3937-4900-bb59-1b46f59bbd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:01.276627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3fa2-3937-4900-bb59-1b46f59bbd74 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:01.277218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf3fa2-3937-4900-bb59-1b46f59bbd74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:01.278655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf3fa2-3937-4900-bb59-1b46f59bbd74 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:01.284805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 499/993] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:46:01 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:46:01.303513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:01.332132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705fc9e-b79c-4409-b620-cc95b59c6623 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:01.375919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:01.376554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:01.376834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:01.377110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:01.377783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:01.378089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:01.379490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc731bd-754d-4801-ad14-ecd691dce7a8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:01.393449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 495/994] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:02.283320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae22d7-b80a-4dca-ae8c-61fdd51d6049 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:02.283840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae22d7-b80a-4dca-ae8c-61fdd51d6049 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:02.283840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae22d7-b80a-4dca-ae8c-61fdd51d6049 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:02.285347 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 500/995] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:02.290819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:02.291221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:02.291386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:02.309466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:02.310631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:02.386392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 496/996] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:02.647937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae22d7-b80a-4dca-ae8c-61fdd51d6049 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:02.689352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:02.750476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae22d7-b80a-4dca-ae8c-61fdd51d6049 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:02.785224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:02.785877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:02.786157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:02.786426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:02.786985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:02.788369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:02.796979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:02.798157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:46:02.799006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:02.801576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 501/997] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:46:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:02.804417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:02.870758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:02.905539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe906-c782-46c7-b412-51723cdaf6e6 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:02.939389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:02.939992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:02.940265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:02.940534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:02.941152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:02.941478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:02.942824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:02.952609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 497/998] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:46:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:02.953875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.056844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677368-9e44-4205-a0dc-c43516409310 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.058417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.091779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.092382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.092663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.092992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.093636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:03.093953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.095300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28019-e223-4b8e-a2aa-b7638162c37b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.105290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 502/999] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:46:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:03.106542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.205645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d17c-dcc3-465c-907c-71676b5b1d59 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.205935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d17c-dcc3-465c-907c-71676b5b1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.206209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d17c-dcc3-465c-907c-71676b5b1d59 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.207678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 503/1000] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:03.208545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608688d-06a8-46c8-b8ac-99f49bcfb1bb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.212978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a1e9-19a0-4d9e-b151-2e7f61a29dc2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.213254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a1e9-19a0-4d9e-b151-2e7f61a29dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.213549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a1e9-19a0-4d9e-b151-2e7f61a29dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.231843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9ac0a1e9-19a0-4d9e-b151-2e7f61a29dc2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:03.233015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9ac0a1e9-19a0-4d9e-b151-2e7f61a29dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:03.239105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.244968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.245615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.245899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.246172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.246867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] RBAC: Adding query filter params (interface=public, service_id=736170e626fd4d0dae6f830944f65698, region_id=RegionOne) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:03.247178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.248528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.258215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 498/1001] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/endpoints?service_id=736170e626fd4d0dae6f830944f65698&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:03.259207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.305535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 504/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:03.312969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f298f0-bfd5-4832-a0b1-2517d3555630 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.313278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f298f0-bfd5-4832-a0b1-2517d3555630 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.313596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f298f0-bfd5-4832-a0b1-2517d3555630 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.314996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 505/1003] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:03.319802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.320090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.320410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.339998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:03.339998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:03.374807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe52bf1-4353-423a-a6dd-0431644815be None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.410864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 506/1004] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:03.413247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.413930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.414213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.414488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.415088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.416513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.426950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 499/1005] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:46:03.579756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.607586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.682192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b5ef-a825-46b7-bb3a-116da36f0493 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.710178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.717662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.718307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.718581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.718846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.719423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.720767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:03.729808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:03.730829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:03.731689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 507/1006] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:03.736639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.778347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.821846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc3c0-b5c8-43b1-ad5b-672c5edd4ccf None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.837662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.848515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82828d-9ca3-4aa5-b90c-bdd9e43ebf73 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.857630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.858251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.858527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.858806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.859446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.860804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.878270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 500/1007] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:46:03 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:03.898831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.899460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.899739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.900010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.900656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:03.900960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.902432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.908286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 508/1008] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:03.914656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:04.027627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b16d-5be4-4c87-8f53-6ba6e74525d6 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:04.048898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:04.066570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:04.066570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:04.067002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:04.067171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:04.069311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:04.069311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:04.069494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9815bfb-ce9c-4000-a478-87aaee7bff92 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:04.075010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 501/1009] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:04.080525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:04.182630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee63d6f-9b7c-4ce4-bb2d-ad552434cb45 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:04.216251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfe672-10be-4ac7-88b7-5839b75d4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:04.216858 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfe672-10be-4ac7-88b7-5839b75d4c63 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:04.217137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfe672-10be-4ac7-88b7-5839b75d4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:04.217442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfe672-10be-4ac7-88b7-5839b75d4c63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:04.218104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfe672-10be-4ac7-88b7-5839b75d4c63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:04.219464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfe672-10be-4ac7-88b7-5839b75d4c63 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:04.239939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 509/1010] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:46:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:05.327898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cbc9-3cc8-41ea-bd9b-df55be85a86b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.328464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cbc9-3cc8-41ea-bd9b-df55be85a86b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.328464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cbc9-3cc8-41ea-bd9b-df55be85a86b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.329845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 502/1011] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:05.335056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cb735-cde9-4d49-93e2-725ae58ff6f4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.335436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cb735-cde9-4d49-93e2-725ae58ff6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.335619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cb735-cde9-4d49-93e2-725ae58ff6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.354191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-517cb735-cde9-4d49-93e2-725ae58ff6f4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:05.355366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-517cb735-cde9-4d49-93e2-725ae58ff6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:05.358185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:05.430514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 510/1012] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:05.700360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cbc9-3cc8-41ea-bd9b-df55be85a86b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:05.801640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cbc9-3cc8-41ea-bd9b-df55be85a86b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:05.835631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:05.836268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.836511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7ace-8524-4bc8-9f79-4866e4b5200f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.836643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.836804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7ace-8524-4bc8-9f79-4866e4b5200f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.836901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.837065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7ace-8524-4bc8-9f79-4866e4b5200f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.837397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:05.838571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 511/1013] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:05.838740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:05.844016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.844300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.844571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:05.848036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:05.849017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:05.850594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 503/1014] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:46:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:05.855493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:05.867178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:05.868429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:05.914169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:05.949300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 512/1015] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:05.968106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd52544-896b-4631-9323-5f25370240a1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.002597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.003203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.003539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.003808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.004486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] RBAC: Adding query filter params (name=compute) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:06.004787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.006699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae634d-8ede-4cbc-a067-1519fce50def None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.016727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 504/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:46:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:06.017571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.083577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.119143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e324d-1a7e-4161-85be-e9f746e8a21f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.153163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.153800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.154076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.154633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.154959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:06.155257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.156081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7856-8314-4b86-8fb5-6f710802d4af None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.156372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7856-8314-4b86-8fb5-6f710802d4af None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.156601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.156700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7856-8314-4b86-8fb5-6f710802d4af None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.158154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 505/1017] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:06.166073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 513/1018] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:06.166210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.166210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.166210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.166793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.182292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:06.183575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:06.250030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 506/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:06.250774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.273322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bcd04-2fd2-475a-84ce-3afff95e63c8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.294833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.303196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.309565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.310169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.310445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.310713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.311371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.312693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.347874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 514/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:46:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:46:06.364458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2df666-2a67-4a59-b013-c18532ca1ea2 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.411870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.413082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.413399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.413711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] PATH_INFO: `/v3/services/image` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.414304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.415686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:06.425242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:06.426375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:06.427863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 507/1021] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:06.433146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.518289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.544257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3a5e-f57c-4381-831d-48c0ce72daf6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.586373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.586600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.586902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.587108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.588588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:06.588588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.589420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.594655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 515/1022] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:06.602998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.632534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4a8b-e51e-4bc6-a112-9a815e714a95 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.634254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.660760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.669392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.670452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.670885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.671221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.672822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.674286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.676214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 508/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:06.682023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.719075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248d00-2037-4053-96d7-48d58d4ed1e4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.755326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.755957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.756752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.757026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.757684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] RBAC: Adding query filter params (type=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:06.757985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.759341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.764476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 516/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:06.770443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.793724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccc49b-a6b4-4313-a4e7-76ac9006ade8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.828665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.829329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.829607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.829874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.830509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.831949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.869478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 509/1025] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:46:06 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:46:06.880688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedef81d-66a0-4bca-aa8d-7ddd3b87f3af None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.898266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.922756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.923387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.923672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.923945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.924659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] RBAC: Adding query filter params (interface=public, service_id=6ce6f424f1cc428ea1050aebc1134f92, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:06.924978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.926455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70779459-4c86-4e9e-96aa-08cd48d0de2b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.933297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 517/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/endpoints?service_id=6ce6f424f1cc428ea1050aebc1134f92&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:06.938857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.965621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:07.051602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2546c3-64ec-4554-a036-b45d2b0994b6 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:07.086857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3e455-4b3e-4e43-9463-1faf27812e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:07.087907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e455-4b3e-4e43-9463-1faf27812e07 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:07.088433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e455-4b3e-4e43-9463-1faf27812e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:07.088923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e455-4b3e-4e43-9463-1faf27812e07 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:07.089847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3e455-4b3e-4e43-9463-1faf27812e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:07.091496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3e455-4b3e-4e43-9463-1faf27812e07 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:07.098571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 510/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:46:06 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:46:08.341651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399365-6fe5-4c30-b0d6-5d41e41fe3b2 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.342657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399365-6fe5-4c30-b0d6-5d41e41fe3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.343755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75399365-6fe5-4c30-b0d6-5d41e41fe3b2 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.347168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 518/1028] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:08.352155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abe1f6-61a3-472f-a97b-7ee076034372 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.352565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abe1f6-61a3-472f-a97b-7ee076034372 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.352751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abe1f6-61a3-472f-a97b-7ee076034372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.371055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-82abe1f6-61a3-472f-a97b-7ee076034372 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:08.372248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-82abe1f6-61a3-472f-a97b-7ee076034372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:08.441428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 511/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:08.710665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75399365-6fe5-4c30-b0d6-5d41e41fe3b2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:08.811814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55168e-8f18-40a3-a24c-16030339ef94 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.812138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55168e-8f18-40a3-a24c-16030339ef94 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.812378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55168e-8f18-40a3-a24c-16030339ef94 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.813791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 512/1030] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:08.819268 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75399365-6fe5-4c30-b0d6-5d41e41fe3b2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:08.819875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7ec7c-23e3-4859-b15e-366ef0284c77 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.820167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7ec7c-23e3-4859-b15e-366ef0284c77 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.820448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7ec7c-23e3-4859-b15e-366ef0284c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.838236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-09e7ec7c-23e3-4859-b15e-366ef0284c77 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:08.839424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-09e7ec7c-23e3-4859-b15e-366ef0284c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:08.851024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:08.857765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:08.858398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.858679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.859112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.871109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:08.876328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:08.877302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:08.878687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 519/1031] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 07:46:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:08.883233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:08.913313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 513/1032] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:08.925860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:08.985582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877722-3911-4ff7-a31f-8589837b160e None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.985854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877722-3911-4ff7-a31f-8589837b160e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.986043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877722-3911-4ff7-a31f-8589837b160e None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.987400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 514/1033] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:08.989293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e305bb-52c3-4520-ad12-44d4d761937c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:08.992559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.992909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.993184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.012057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:09.013225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:09.025686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.026295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.026578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.026852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.027509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:09.027810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.029154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.038400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 520/1034] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:46:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:09.044026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.086467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 515/1035] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:09.148272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.151780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ebdba-cf5d-4660-af0c-f934d0417bb2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.180721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.188633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.189889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.190348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.190772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.202310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.203727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:09.218786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:09.219736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:09.220629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:09.220629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:09.220629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:09.220629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 521/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:09.226449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.267884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.294100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd8594-70ce-4a63-9325-0b5fca37e6a7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.330038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9bf15-01d7-4fd1-8c89-7d605be43b8d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.330214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.330675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.330950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.331217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.332572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.334532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.340820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 516/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:09.342524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.369825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.370432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.370706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.370979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.371610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:09.371909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.373288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.384863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 522/1038] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:09.385690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.400501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.446355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd530ab-e36e-4d21-b2a8-9c4bec866a8d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.479975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.480570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.480851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.481126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.481793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.483210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.484300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818712fa-defc-4e3c-884e-d5cfb782bfee None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.500530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.513301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 517/1039] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:46:09 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:09.513301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.525571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.526288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.526503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.526778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] PATH_INFO: `/v3/services/image` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.527374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.528784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:09.538295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:09.539399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:09.540677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 523/1040] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:09.545607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.632013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.632742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf732a8-fec8-45f3-8bd8-1a25a861dede None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.657835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467f2dd-7c2c-4c25-80ad-93f0fb736b95 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.677049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.677752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.678584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.678860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.686736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.688177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.694873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.695475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.695750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.696027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.696626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:09.696920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.698295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:46:09.700069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:09.701026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:09.707487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 518/1041] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:09.708103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 524/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:09.709403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.710518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.776585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.823682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9a898-8263-48f8-8304-c75b3a04661b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.824859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3890-9673-4b5e-aa42-5ef6e714e8d7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.858299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.858903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.859184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.859460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.860186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:09.860493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.860597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.861175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.861478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.861755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.862109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.862367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] RBAC: Adding query filter params (type=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:09.862661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.863996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.869752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 525/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:09.875354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.878865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.890456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 519/1044] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:09.891694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:09.986532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575183-b3f3-4258-ae31-125c3cadda92 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.999403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a904d-0c26-4274-b4da-ee63727d8045 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:10.017851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:10.032515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:10.033051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:10.033359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:10.033641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:10.034296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:10.035753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:10.038584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:10.039192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:10.039471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:10.039744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:10.057368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 526/1045] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:46:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:46:10.127296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:10.129144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:10.244497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 520/1046] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:10.250078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:10.314252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:10.369571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba703da-9dbe-4114-86bd-5885023054cd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:10.404339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:10.405658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:10.406125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:10.406543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:10.418112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:10.419807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:10.435039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:10.436024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:10.436969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:10.436969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:10.436969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:10.436969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 527/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:10.443163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:10.461968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:10.546950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6d618-e19e-4dae-a26c-be8f5559c7de None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:10.582632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:10.583159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:10.583435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:10.583703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:10.584396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:10.584693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:10.586096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:10.597745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 521/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:10.603640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:10.705462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87f50e-918a-4260-93c4-b4b2443425a2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:10.714872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:10.741225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:10.741884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:10.742162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:10.742440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:10.748874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:10.750325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:46:10.761239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:10.762156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:46:10.763067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:10.765605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 528/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:10.768086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:10.846859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:10.869763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2a362-81ad-433e-a899-ea90ebf19687 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:10.904143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:10.904980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:10.905520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:10.905940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:10.906789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:10.907242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:10.908813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f57210-b020-4156-8f14-68076cd25951 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:10.921493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 522/1050] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:10.927151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:11.030545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9dc26-aefc-4142-9573-c44453e16605 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:11.065333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:11.065944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.066224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.066498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.067211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] RBAC: Adding query filter params (role.id=7e6f74fc579f48c7946d0a66ec5ac774, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8324e7cb70744038987b7d15f002160f) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:11.067517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:11.069528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4986b2-be7f-481f-9059-a9b8ecb31e15 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:11.081342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 529/1051] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:10 2022] GET /identity/v3/role_assignments?user.id=8324e7cb70744038987b7d15f002160f&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=7e6f74fc579f48c7946d0a66ec5ac774 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:11.462578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff687-4792-454d-9cf8-69270962998c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.463134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff687-4792-454d-9cf8-69270962998c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.463134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff687-4792-454d-9cf8-69270962998c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.464482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 523/1052] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:11.469563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.469979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.470147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.488455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:11.489669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:11.515602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:11.558320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 530/1053] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:11.823302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ff687-4792-454d-9cf8-69270962998c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:11.923801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ff687-4792-454d-9cf8-69270962998c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:11.957166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bac44-99af-4318-9e88-58aaa828648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:11.957818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bac44-99af-4318-9e88-58aaa828648f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.958097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bac44-99af-4318-9e88-58aaa828648f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.958365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bac44-99af-4318-9e88-58aaa828648f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.965630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:11.970628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bac44-99af-4318-9e88-58aaa828648f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-539bac44-99af-4318-9e88-58aaa828648f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:11.975286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:11.976240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:11.977173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:11.978687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 524/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:11.982374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.003461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9b75-0552-4d9d-a103-4711d247aebb None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.004366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9b75-0552-4d9d-a103-4711d247aebb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.004655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9b75-0552-4d9d-a103-4711d247aebb None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.006531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 525/1055] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:12.011623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.011906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.012230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.033960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:12.035923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:12.089832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b771fe-62f1-47ab-8c41-6cef640dfea3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.111939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 526/1056] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:12.126650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.127265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.127542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.127811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.128468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:12.128767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.130150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.139623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 531/1057] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:12.145204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.244945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc68fd4-b29e-482b-8555-7302b0160848 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.271023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:12.280097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.280726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.281010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.281433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] PATH_INFO: `/v3/users/637165cc25e14349ac8982b4fe094876` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.294548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] RBAC: Authorizing `identity:get_user(user_id=637165cc25e14349ac8982b4fe094876)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.296014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.302299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 527/1058] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/users/637165cc25e14349ac8982b4fe094876 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:12.304016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.330749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:12.387113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.418155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da0761-e33b-4ed2-b618-368ae280eccf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.454584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.455353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.455710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.456053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.497890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbfd2-ee94-4f73-a7bb-324b8a82909a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.528803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.530352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.534912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.535523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.535802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.536071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.556029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:12.596736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:12.612035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.613539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.637988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 532/1059] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:46:12.643574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.725306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 528/1060] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:46:12.728552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.745000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe35293-b483-41f3-adf5-1ab199af1166 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.768999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:12.782931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.783553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.783831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.784098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.785197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29dde660a246b3ad620ef8d07cfcb5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.786799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.793428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 533/1061] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:12.794374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.824845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:12.841547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb1c9-93bf-4a7c-a781-e3a80855b4e1 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.876776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.877360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.877641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.877913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.888612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.890068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.905145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a686-a9b8-4df4-b4c0-1f060faed6f2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:12.905460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:12.906609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:12.907750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:12.907750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:12.907750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:12.911369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 529/1062] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:12.912618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:12.950106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:12.950723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.951003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.951276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.951991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5, user.id=637165cc25e14349ac8982b4fe094876) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:12.952297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:12.953746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9bde8-829b-4da4-914d-427182a4daa9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:12.959155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 534/1063] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/role_assignments?user.id=637165cc25e14349ac8982b4fe094876&scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:12.960414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fead3-1290-47a3-ac33-4ba8288a5d12 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.960707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fead3-1290-47a3-ac33-4ba8288a5d12 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.960977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fead3-1290-47a3-ac33-4ba8288a5d12 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.962503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 535/1064] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:12.967833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:12.968116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:12.968387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:12.987153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:12.988374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:13.027348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485e94-bd65-4503-ac7e-9f56e9aa71e5 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:13.046028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:13.064440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 536/1065] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:13.065593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:13.066432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.066714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.067001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.067643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:13.067950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:13.069417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:13.077229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:13.084662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 530/1066] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:13.332857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:13.436868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f90d-aa88-4f90-bb4a-d122d6650a1a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:13.471147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:13.471769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.472046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.472313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.482197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:13.486824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:13.487924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:13.488970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 537/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 07:46:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:13.493783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:13.591945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995051-28ba-4213-ba26-f501b9b359cc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:13.625094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:13.625716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.625992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.626259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.626902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:13.627200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:13.628535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:13.636720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 531/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:46:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:13.642471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:13.689367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:13.741185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a064-f169-4af1-b18e-bde1b75e2e77 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:13.775651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:13.776283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.776563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.776834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.787851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:13.789306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:13.803986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:13.804929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:13.806399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:13.806399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:13.806399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:13.806399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 538/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:13.810900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:13.868696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:13.910001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eda6a1-d2d0-4344-bd2e-3fda3436ff50 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:13.942917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:13.944087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.944363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.944636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.945284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:13.945591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:13.946940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:13.958255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 532/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:13.963897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.061735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.065972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411083d-3844-42e0-9fee-ea51197185f8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.098701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.099324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.100139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.100413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.107703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.109130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:46:14.120449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:14.121416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:14.122915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 539/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:46:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:14.127270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.223807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6b786-db6f-4b5c-b1b2-9f4e3ad47038 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.244934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.259574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.260180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.260457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.260733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.261482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:14.261789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.263320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.280541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 533/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:14.286291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.384928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de017d-47b6-47a7-955a-36e74249d66c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.423560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.424187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.424463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.424731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.435525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.436948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:14.450412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:14.451553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:14.452486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:14.452486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:14.452486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:14.452486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 540/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:14.457403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.554696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210ee5-4907-4641-b396-8866871be3f8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.587281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.587877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.588156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.588426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.589058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:14.589401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.590751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.602263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 534/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:14.607939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.620857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.706058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e182-f142-4b93-8339-0caa7d5a4f88 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.738801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.739423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.739700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.739971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.747066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.748483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ae0ed11e-0e77-42f6-a2fb-11017e551edc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:46:14.760096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:14.760997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:14.762275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 541/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:14.766947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.806817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.831120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268de31-35e6-478d-83a1-8ee2afa75866 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.831405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268de31-35e6-478d-83a1-8ee2afa75866 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.831660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268de31-35e6-478d-83a1-8ee2afa75866 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.832980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 542/1076] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:14.837982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.838261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.838533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.856494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:14.857699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:14.867509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9379b35-f61c-4dc1-a1fa-ea08d3dbc778 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.900941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.901583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.901868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.902140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.902823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:14.903127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.904539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.916418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 535/1077] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:14.920957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.922328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.926996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 543/1078] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:15.014803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:15.018538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcef543-12c9-48a8-b82e-43c4d587d8c8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.051446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.052089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.052371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.053231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8324e7cb70744038987b7d15f002160f/roles/7e6f74fc579f48c7946d0a66ec5ac774` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.055577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=8324e7cb70744038987b7d15f002160f, role_id=7e6f74fc579f48c7946d0a66ec5ac774)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.057078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.069710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 536/1079] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:46:14 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8324e7cb70744038987b7d15f002160f/roles/7e6f74fc579f48c7946d0a66ec5ac774 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:46:15.197059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.299669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535115f-deeb-4eec-b705-0c4aaa3721bd None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.331998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.332616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.332890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.333159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.343726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:15.348450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:15.349484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:15.350923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 544/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:15.356089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.453701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20a091-8f71-4b3f-ba0d-7ae0a3604002 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.487200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.487802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.488077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.488343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.488988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:15.489314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.490667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.499187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 537/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:15.504921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.564832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:15.605395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762a05-4ee3-47e8-8914-1f60c7fe2573 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.637704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.638339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.638601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.638871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] PATH_INFO: `/v3/users/637165cc25e14349ac8982b4fe094876` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.639972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] RBAC: Authorizing `identity:get_user(user_id=637165cc25e14349ac8982b4fe094876)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.641417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.642981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 545/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:15 2022] GET /identity/v3/users/637165cc25e14349ac8982b4fe094876 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:15.649559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.670492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:15.746154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305587d-2924-46c2-91bd-fd99034bc3f2 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.778313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b23fdc-7d7a-4b79-90f5-3bdedceff07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.778925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23fdc-7d7a-4b79-90f5-3bdedceff07f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.779199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23fdc-7d7a-4b79-90f5-3bdedceff07f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.779466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23fdc-7d7a-4b79-90f5-3bdedceff07f None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.780544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b23fdc-7d7a-4b79-90f5-3bdedceff07f None admin] RBAC: Authorizing `identity:get_project(project_id=9e29dde660a246b3ad620ef8d07cfcb5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.781976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b23fdc-7d7a-4b79-90f5-3bdedceff07f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.783576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 538/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:15 2022] GET /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:15.790063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.886919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd60b5-ee54-46c9-bd55-9db6ef1ba48d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.912479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:15.920644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c722eb7-1cd6-4b6b-852a-6b61f934595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.921343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722eb7-1cd6-4b6b-852a-6b61f934595a None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.921620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722eb7-1cd6-4b6b-852a-6b61f934595a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.921890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722eb7-1cd6-4b6b-852a-6b61f934595a None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5/users/637165cc25e14349ac8982b4fe094876/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.923739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722eb7-1cd6-4b6b-852a-6b61f934595a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e29dde660a246b3ad620ef8d07cfcb5, user_id=637165cc25e14349ac8982b4fe094876, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.925169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722eb7-1cd6-4b6b-852a-6b61f934595a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.937625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 546/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:46:15 2022] PUT /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5/users/637165cc25e14349ac8982b4fe094876/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:46:16.938727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6029-7ceb-4695-aac7-d7cc5979e6c7 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:16.939326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6029-7ceb-4695-aac7-d7cc5979e6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:16.939326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6029-7ceb-4695-aac7-d7cc5979e6c7 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:16.940607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 539/1085] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:16.946537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:16.946969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:16.947153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:16.964643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:16.965841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:17.033286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 547/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:17.304407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be6029-7ceb-4695-aac7-d7cc5979e6c7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.392492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:17.406530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be6029-7ceb-4695-aac7-d7cc5979e6c7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.439134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.439753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.440027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.440294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.451034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:17.455727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:17.456837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:17.458148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 540/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:17.462708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.557933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25b1fa-a280-481a-8a74-ff86e4ea1f88 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.574827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:17.592050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.592647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.592924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.593193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.593866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:17.594165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:17.595534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:17.603490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 548/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:17.608864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.705976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31757-765d-456d-874f-2c9e6719f851 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.738095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.738716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.738994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.739266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.749504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:17.750927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:17.760471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-26faba4b-9774-44f8-8c1a-5b12ca45de5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:17.767415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:17.768617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:17.774975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:17.774975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:17.774975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:17.774975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 541/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:17.775253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.810134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e04ec-6a90-4341-9991-05de51693bb4 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.810376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e04ec-6a90-4341-9991-05de51693bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.810614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e04ec-6a90-4341-9991-05de51693bb4 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.811952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 542/1090] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:17.816778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.817061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.817390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.835168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:17.836365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:17.876055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340ee09-940a-44ad-ac36-5bb30ef35125 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.902254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 543/1091] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:17.908492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.909089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.909392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.909662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.910281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:17.910577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:17.912472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:17.928930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 549/1092] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:17.930034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.025898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb7488-2518-411f-a414-74ac26adaad6 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.053940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.060081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.060743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.060968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.061231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.067980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.069459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:46:18.080391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:18.086481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:18.087509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 544/1093] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:18.088106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.128738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.167005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.186383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e3cc6-0efa-4c2a-ab8c-b3e6a5ec31c4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.221664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.222264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.222546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.222826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.223538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:18.223841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.225826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.242778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 550/1094] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:18.248425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.269018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b6ef2-15e0-435d-b688-153b11293bcd None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.303003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.303628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.303907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.304181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.314568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:18.319731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:18.320837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:18.322117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 545/1095] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:18.326626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.344314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.348528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b630f9-52b4-43d7-a5bf-f6aa875edbad None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.378433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.383512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.384117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.384394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.384663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.428294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcd1c5-2cad-40da-934a-ae20e1aa605a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.451334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.452769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.461065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.461699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.461974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.462241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.462884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:18.463181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.464513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.472700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 546/1096] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:18.479041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.548828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.554509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 551/1097] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:46:18.559848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.575219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d01e4-ed45-40a2-bb55-a08ae90f4f71 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.587864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.609817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.610445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.610735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.611004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] PATH_INFO: `/v3/users/637165cc25e14349ac8982b4fe094876` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.612127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] RBAC: Authorizing `identity:get_user(user_id=637165cc25e14349ac8982b4fe094876)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.613583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.615773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 547/1098] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/users/637165cc25e14349ac8982b4fe094876 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:18.621434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.659520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325986-045a-483e-be96-2edaed7c62dc None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.693252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.693903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.694181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.694453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.704114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.705565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.717521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7357-31b6-49a3-991c-bfa14fcd1d9f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:18.719809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:18.721048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:46:18.722226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:18.722226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:46:18.722226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:18.726319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 552/1099] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:18.727072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.751125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.751736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.752014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.752285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.777028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.800186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.820077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.821577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.827879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b26eb-9e97-4611-8606-c275bf15fa28 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.860798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.861431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.861714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.861987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.862618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:18.862919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.864267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.876597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 553/1100] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:18.882114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.918947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 548/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:46:18.924941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.981322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee09ff-b459-4d09-aa92-6b805fe3bdd4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.991748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:19.004233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:19.014946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:19.015571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:19.015849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:19.016119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:19.023314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:19.024720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:19.025107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87029e11-fc1f-4cc4-9042-cfb1e368da7d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:46:19.035463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:19.036560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:19.038335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 554/1102] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:19.042961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:19.063181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:19.063802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:19.064077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:19.064344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:19.065459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29dde660a246b3ad620ef8d07cfcb5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:19.066866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:19.068521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 549/1103] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:18 2022] GET /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:19.074541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:19.144337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc15f88-ca86-43d4-9441-6792b751f93f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:19.173975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33445f-e3b6-459d-9644-d1d3cb29ad51 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:19.177128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:19.178291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:19.178569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:19.178842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:19.179516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:19.179820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:19.181227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:19.192804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 555/1104] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:19.199249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:19.209077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:19.209702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:19.209975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:19.210240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:19.210948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5, user.id=637165cc25e14349ac8982b4fe094876) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:19.211352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:19.212760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8694e-8d2c-4756-825c-9c2cfe36c218 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:19.218487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 550/1105] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:19 2022] GET /identity/v3/role_assignments?user.id=637165cc25e14349ac8982b4fe094876&scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:19.231427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:19.306145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95897ae-aa49-4eb8-8a2f-fbe95784e172 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:19.342409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:19.342749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:19.343025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:19.343291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:19.344011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] RBAC: Adding query filter params (role.id=7e6f74fc579f48c7946d0a66ec5ac774, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8324e7cb70744038987b7d15f002160f) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:19.344371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:19.345797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422a65-08ab-4918-b1d0-a473a88b3454 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:19.354704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 556/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:19 2022] GET /identity/v3/role_assignments?user.id=8324e7cb70744038987b7d15f002160f&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=7e6f74fc579f48c7946d0a66ec5ac774 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:46:21.137653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2adfe8-d409-446d-84fd-c1957d291309 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.138201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2adfe8-d409-446d-84fd-c1957d291309 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.138201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2adfe8-d409-446d-84fd-c1957d291309 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.139507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 551/1107] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:21.144765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.145156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.145366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.163715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:21.164895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:21.229793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 557/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:21.497884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2adfe8-d409-446d-84fd-c1957d291309 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:21.513461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:21.597936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2adfe8-d409-446d-84fd-c1957d291309 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:21.630967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910da52-a90d-4b15-8fab-7783a85555ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:21.631582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910da52-a90d-4b15-8fab-7783a85555ca None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.631861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910da52-a90d-4b15-8fab-7783a85555ca None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.632133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910da52-a90d-4b15-8fab-7783a85555ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.633227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910da52-a90d-4b15-8fab-7783a85555ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:21.634666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910da52-a90d-4b15-8fab-7783a85555ca None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:21.636211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 552/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:21.641883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:21.666307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:21.743425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397bb30-9891-4113-8c45-d8c364b81d20 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:21.775896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0cf8-63a8-4232-8cb3-611f7557a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:21.776466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0cf8-63a8-4232-8cb3-611f7557a8ef None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.776706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0cf8-63a8-4232-8cb3-611f7557a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.776977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0cf8-63a8-4232-8cb3-611f7557a8ef None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.777677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e0cf8-63a8-4232-8cb3-611f7557a8ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:21.779061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e0cf8-63a8-4232-8cb3-611f7557a8ef None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:21.799520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 558/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:46:21 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:23.730439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3842-398c-4fcf-9cc0-c79847409530 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:23.730966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3842-398c-4fcf-9cc0-c79847409530 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:23.730966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3842-398c-4fcf-9cc0-c79847409530 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:23.732310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 553/1111] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:23.737541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:23.737913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:23.738100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:23.756899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:23.758136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:23.824492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 559/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:24.096343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3842-398c-4fcf-9cc0-c79847409530 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:24.175988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.196303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3842-398c-4fcf-9cc0-c79847409530 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:24.229402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:24.230017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:24.230296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:24.230568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] PATH_INFO: `/v3/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:24.231948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] RBAC: Authorizing `identity:get_role(role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:24.233322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:24.234630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 554/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:24 2022] GET /identity/v3/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:24.240354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:24.251642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.337879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be585e4-3cb4-4eb1-95ed-be42795b75fd None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:24.371844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:24.372408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:24.372685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:24.372956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] PATH_INFO: `/v3/users/75f0826239dd4b1db2682114834a05d8` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:24.386196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] RBAC: Authorizing `identity:get_user(user_id=75f0826239dd4b1db2682114834a05d8)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:24.387614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:24.389195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 560/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:24 2022] GET /identity/v3/users/75f0826239dd4b1db2682114834a05d8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:24.394959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:24.491387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb84ba-891e-4d44-b37c-60c0440f2d2d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:24.523790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:24.524378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:24.524658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:24.524933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:24.541562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.589469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:24.590901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:24.685209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 555/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:24.691034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:24.755163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.788687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd9bd-c75b-4297-b179-8fe2b86da79a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:24.821532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ff819-f174-4030-abe9-befff03858b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:24.822150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ff819-f174-4030-abe9-befff03858b3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:24.822431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ff819-f174-4030-abe9-befff03858b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:24.822704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ff819-f174-4030-abe9-befff03858b3 None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:24.823800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ff819-f174-4030-abe9-befff03858b3 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29dde660a246b3ad620ef8d07cfcb5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:24.825210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ff819-f174-4030-abe9-befff03858b3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:24.826844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 561/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:24 2022] GET /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:24.833197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:24.879557 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.929007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64005-9328-48de-8135-eec6e20ece22 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:24.961408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:24.961934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:24.962212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:24.962482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:24.963176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] RBAC: Adding query filter params (role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5, user.id=75f0826239dd4b1db2682114834a05d8) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:24.963478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:24.964877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda841-9188-490b-8f4d-7d74d8453c58 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:24.970024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 556/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:24 2022] GET /identity/v3/role_assignments?user.id=75f0826239dd4b1db2682114834a05d8&scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:26.804266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bbe3f-21dd-4264-a311-87e61a176a89 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:26.804799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bbe3f-21dd-4264-a311-87e61a176a89 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:26.804799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bbe3f-21dd-4264-a311-87e61a176a89 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:26.806182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 562/1118] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:26.811167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:26.811579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:26.811719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:26.829749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:26.830925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:26.896814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 557/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:27.164672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bbe3f-21dd-4264-a311-87e61a176a89 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:27.262655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bbe3f-21dd-4264-a311-87e61a176a89 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:27.294712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:27.295319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:27.295598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:27.295870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] PATH_INFO: `/v3/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:27.297241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] RBAC: Authorizing `identity:get_role(role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:27.298617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:27.299900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 563/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:27 2022] GET /identity/v3/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:27.306158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:27.348014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:27.403295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fe44f-0003-4668-afe5-e989e5fab8de None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:27.436058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:27.436618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:27.436899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:27.437171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] PATH_INFO: `/v3/users/75f0826239dd4b1db2682114834a05d8` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:27.438307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] RBAC: Authorizing `identity:get_user(user_id=75f0826239dd4b1db2682114834a05d8)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:27.439739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:27.441329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 558/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:27 2022] GET /identity/v3/users/75f0826239dd4b1db2682114834a05d8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:27.447698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:27.451439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:27.545954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138660c-44f0-4fbc-9ffa-2ec0bafa4e4c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:27.579588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c33eb-b0d0-4ce2-9fb1-683e8e864e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:27.580200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c33eb-b0d0-4ce2-9fb1-683e8e864e02 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:27.580479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c33eb-b0d0-4ce2-9fb1-683e8e864e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:27.580750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c33eb-b0d0-4ce2-9fb1-683e8e864e02 None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:27.581857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c33eb-b0d0-4ce2-9fb1-683e8e864e02 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29dde660a246b3ad620ef8d07cfcb5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:27.583269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c33eb-b0d0-4ce2-9fb1-683e8e864e02 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:27.585441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 564/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:27 2022] GET /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:27.591151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:27.686801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf273b-0da8-4b7a-a949-12d7e39eb225 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:27.697155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:27.720022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff901c49-bf81-449f-a721-d1e9b9321997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:27.720661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901c49-bf81-449f-a721-d1e9b9321997 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:27.720938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901c49-bf81-449f-a721-d1e9b9321997 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:27.721209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff901c49-bf81-449f-a721-d1e9b9321997 None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5/users/75f0826239dd4b1db2682114834a05d8/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:27.723346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff901c49-bf81-449f-a721-d1e9b9321997 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e29dde660a246b3ad620ef8d07cfcb5, user_id=75f0826239dd4b1db2682114834a05d8, role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:27.725248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff901c49-bf81-449f-a721-d1e9b9321997 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:27.737065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 559/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:46:27 2022] PUT /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5/users/75f0826239dd4b1db2682114834a05d8/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:46:29.603239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c05ac-6c48-4b4c-9152-6ecc65faf589 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:29.603759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c05ac-6c48-4b4c-9152-6ecc65faf589 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:29.603759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c05ac-6c48-4b4c-9152-6ecc65faf589 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:29.605039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 565/1124] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:29.610192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:29.610576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:29.610745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:29.628911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:29.630121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:29.694346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 560/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:29.975321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c05ac-6c48-4b4c-9152-6ecc65faf589 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:30.044169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:30.073215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c05ac-6c48-4b4c-9152-6ecc65faf589 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:30.105570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:30.106181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.106456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.106724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] PATH_INFO: `/v3/roles/c76c8996861c4613a9c05b9f75fd8f5e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.108079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] RBAC: Authorizing `identity:get_role(role_id=c76c8996861c4613a9c05b9f75fd8f5e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:30.109439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:30.110728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 566/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:29 2022] GET /identity/v3/roles/c76c8996861c4613a9c05b9f75fd8f5e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:30.116587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:30.208678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:30.211716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f32cf8-3347-44e4-a1f7-dc00f07c3858 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:30.244853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:30.245431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.245708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.245978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] PATH_INFO: `/v3/users/75f0826239dd4b1db2682114834a05d8` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.247067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] RBAC: Authorizing `identity:get_user(user_id=75f0826239dd4b1db2682114834a05d8)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:30.248470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:30.250049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 561/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:30 2022] GET /identity/v3/users/75f0826239dd4b1db2682114834a05d8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:30.256358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:30.354909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c8b2-678e-4352-a7ab-db1fbb06e2b5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:30.387974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:30.388562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.388836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.389102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.399735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:30.454780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:30.456207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:30.550275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 567/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:30.556694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:30.651776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900490ff-0186-4c4a-9a9a-1d10570f2e95 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:30.684216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464590-1e1c-43e0-a239-59b8f137d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:30.684825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464590-1e1c-43e0-a239-59b8f137d745 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.685101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464590-1e1c-43e0-a239-59b8f137d745 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.685428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464590-1e1c-43e0-a239-59b8f137d745 None admin] PATH_INFO: `/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.686515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464590-1e1c-43e0-a239-59b8f137d745 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29dde660a246b3ad620ef8d07cfcb5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:30.687911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464590-1e1c-43e0-a239-59b8f137d745 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:30.689519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 562/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:30 2022] GET /identity/v3/projects/9e29dde660a246b3ad620ef8d07cfcb5 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:30.695423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:30.735017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:30.791629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8e593-2264-454e-9078-33ee8c11448c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:30.824650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:30.825179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.825486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.825760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.826461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] RBAC: Adding query filter params (role.id=c76c8996861c4613a9c05b9f75fd8f5e, scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5, user.id=75f0826239dd4b1db2682114834a05d8) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:30.826765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:30.828177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cca0f-5bbe-491a-b214-c750f4d2dc8f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:30.833883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 568/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:30 2022] GET /identity/v3/role_assignments?user.id=75f0826239dd4b1db2682114834a05d8&scope.project.id=9e29dde660a246b3ad620ef8d07cfcb5&role.id=c76c8996861c4613a9c05b9f75fd8f5e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:32.705500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d109-c5c9-4c16-8fb2-10a6cd6b1d1d None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:32.706028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d109-c5c9-4c16-8fb2-10a6cd6b1d1d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:32.706028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d109-c5c9-4c16-8fb2-10a6cd6b1d1d None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:32.707375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 563/1131] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:32.712469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:32.712900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:32.713032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:32.730733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:32.731915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:32.797584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 569/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:33.066688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d109-c5c9-4c16-8fb2-10a6cd6b1d1d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:33.102389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:33.167229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d109-c5c9-4c16-8fb2-10a6cd6b1d1d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:33.200022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b174-6c25-4151-86f6-5776e909ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:33.200649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b174-6c25-4151-86f6-5776e909ca94 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:33.200954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b174-6c25-4151-86f6-5776e909ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:33.201227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b174-6c25-4151-86f6-5776e909ca94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:33.202357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b174-6c25-4151-86f6-5776e909ca94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:33.203785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b174-6c25-4151-86f6-5776e909ca94 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:33.205360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 564/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:33.211617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:33.243883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:33.307793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a0862-3fe6-4939-92fc-c19f409449c9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:33.339886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbdf0d-43ac-4545-94d6-3a8fb3929ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:33.340418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdf0d-43ac-4545-94d6-3a8fb3929ff1 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:33.340692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdf0d-43ac-4545-94d6-3a8fb3929ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:33.340959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdf0d-43ac-4545-94d6-3a8fb3929ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:33.341613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbdf0d-43ac-4545-94d6-3a8fb3929ff1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:33.343012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbdf0d-43ac-4545-94d6-3a8fb3929ff1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:33.370342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 570/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:46:33 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:46:35.283573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03890e6c-b018-46f7-b01c-9faf80af727b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:35.284117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03890e6c-b018-46f7-b01c-9faf80af727b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:35.284117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03890e6c-b018-46f7-b01c-9faf80af727b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:35.285454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 565/1135] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:35.291336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:35.291761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:35.291898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:35.310269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:35.311456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:35.376085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 571/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:35.649342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03890e6c-b018-46f7-b01c-9faf80af727b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:35.746732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03890e6c-b018-46f7-b01c-9faf80af727b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:35.748949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:35.780941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99895aaf-c2b1-460c-9a61-f24e66e72b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:35.781773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895aaf-c2b1-460c-9a61-f24e66e72b99 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:35.782087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895aaf-c2b1-460c-9a61-f24e66e72b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:35.782388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895aaf-c2b1-460c-9a61-f24e66e72b99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:35.783624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99895aaf-c2b1-460c-9a61-f24e66e72b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:35.785343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99895aaf-c2b1-460c-9a61-f24e66e72b99 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:35.786966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 566/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:46:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:35.793219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:35.810029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:35.890430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d161b4-279c-475f-85b9-b2fd7926774d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:35.923138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906395d1-dc65-4cff-a74c-0f970d3fbf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:35.923724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906395d1-dc65-4cff-a74c-0f970d3fbf44 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:35.923997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906395d1-dc65-4cff-a74c-0f970d3fbf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:35.924261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906395d1-dc65-4cff-a74c-0f970d3fbf44 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:35.924894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906395d1-dc65-4cff-a74c-0f970d3fbf44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:35.926315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906395d1-dc65-4cff-a74c-0f970d3fbf44 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:35.947274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 572/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:46:35 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:37.870150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd27357-22b1-48a8-8b37-2e08ae3c8f6b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:37.870698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd27357-22b1-48a8-8b37-2e08ae3c8f6b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:37.870698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd27357-22b1-48a8-8b37-2e08ae3c8f6b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:37.872033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 567/1139] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:37.877427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:37.877806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:37.877969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:37.895995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:37.897631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:37.961722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 573/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:38.227695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd27357-22b1-48a8-8b37-2e08ae3c8f6b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:38.326097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd27357-22b1-48a8-8b37-2e08ae3c8f6b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:38.359181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:38.359802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:38.360084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:38.360352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:38.370714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:38.375328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:38.376513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:38.377692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 568/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:38.382481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:38.384620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:38.479315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec834-e60b-470e-8cce-d0f871b40443 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:38.510873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:38.511460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:38.511736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:38.512005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:38.512648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:38.512946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:38.514316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:38.522730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 574/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:38.528346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:38.559155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:38.625269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f8413-21d7-46e6-9b6e-bf81adef2c3f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:38.657458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:38.658067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:38.658344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:38.658612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] PATH_INFO: `/v3/users/0f68275bdd194c40b8988a36eee9765f` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:38.671452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] RBAC: Authorizing `identity:get_user(user_id=0f68275bdd194c40b8988a36eee9765f)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:38.672868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:38.674454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 569/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:38 2022] GET /identity/v3/users/0f68275bdd194c40b8988a36eee9765f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:38.680321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:38.740623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:38.778695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ec64-68a5-4221-a4f5-dbed5f107f0e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:38.811902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:38.812492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:38.812769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:38.813038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:38.877482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:38.878916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:38.937206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:38.973666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 575/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:38.980039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:39.065393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:39.074851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72675b-44b8-4e63-9bbb-ddaa53b0ff28 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:39.106696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9d680-432d-4a15-9ea7-6a7388a7d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:39.107305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9d680-432d-4a15-9ea7-6a7388a7d632 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:39.107610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9d680-432d-4a15-9ea7-6a7388a7d632 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:39.107882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9d680-432d-4a15-9ea7-6a7388a7d632 None admin] PATH_INFO: `/v3/projects/83e0c203e9b54dc5b7e557037aa86b77` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:39.108958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9d680-432d-4a15-9ea7-6a7388a7d632 None admin] RBAC: Authorizing `identity:get_project(project_id=83e0c203e9b54dc5b7e557037aa86b77)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:39.110390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9d680-432d-4a15-9ea7-6a7388a7d632 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:39.111967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 570/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:38 2022] GET /identity/v3/projects/83e0c203e9b54dc5b7e557037aa86b77 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:39.118571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:39.213922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a880c1-96a5-4ce4-849b-022a21780f01 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:39.246560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:39.247145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:39.247425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:39.247698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:39.248408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=83e0c203e9b54dc5b7e557037aa86b77, user.id=0f68275bdd194c40b8988a36eee9765f) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:39.248715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:39.250160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8706e13-5a11-48c4-a7d4-8a18e04ae99f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:39.255322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 576/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:39 2022] GET /identity/v3/role_assignments?user.id=0f68275bdd194c40b8988a36eee9765f&scope.project.id=83e0c203e9b54dc5b7e557037aa86b77&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:41.118906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556eec3-0e49-443d-808d-a2606a7da926 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:41.119479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556eec3-0e49-443d-808d-a2606a7da926 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:41.119479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556eec3-0e49-443d-808d-a2606a7da926 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:41.120784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 571/1147] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:41.125965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:41.126360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:41.126514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:41.144111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:41.145310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:41.167948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:41.210631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 577/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:41.483658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556eec3-0e49-443d-808d-a2606a7da926 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:41.582113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556eec3-0e49-443d-808d-a2606a7da926 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:41.615264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:41.615871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:41.616150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:41.616424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:41.626212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:41.630832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:41.632055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:41.633131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 572/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:41.637877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:41.733870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b665-d453-45bc-8644-f49e99a768af None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:41.765812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:41.766399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:41.766677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:41.766950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:41.767593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:41.767894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:41.769235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:41.777799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 578/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:41.783420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:41.802657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:41.879172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e7be-e1cf-43b1-adb1-aec005560be9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:41.912456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8908-668d-4451-beee-1995616a910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:41.913061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8908-668d-4451-beee-1995616a910f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:41.913364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8908-668d-4451-beee-1995616a910f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:41.913638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8908-668d-4451-beee-1995616a910f None admin] PATH_INFO: `/v3/users/0f68275bdd194c40b8988a36eee9765f` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:41.914738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8908-668d-4451-beee-1995616a910f None admin] RBAC: Authorizing `identity:get_user(user_id=0f68275bdd194c40b8988a36eee9765f)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:41.916164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8908-668d-4451-beee-1995616a910f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:41.917732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 573/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:41 2022] GET /identity/v3/users/0f68275bdd194c40b8988a36eee9765f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:41.923290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:41.945398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:42.023283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd257-c3db-46c8-8b09-6c0ac2d2ded5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:42.054920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442c0c-3e70-4b85-bae5-c91561aab521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:42.055564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442c0c-3e70-4b85-bae5-c91561aab521 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:42.055846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442c0c-3e70-4b85-bae5-c91561aab521 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:42.056118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442c0c-3e70-4b85-bae5-c91561aab521 None admin] PATH_INFO: `/v3/projects/83e0c203e9b54dc5b7e557037aa86b77` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:42.057214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442c0c-3e70-4b85-bae5-c91561aab521 None admin] RBAC: Authorizing `identity:get_project(project_id=83e0c203e9b54dc5b7e557037aa86b77)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:42.058660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442c0c-3e70-4b85-bae5-c91561aab521 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:42.060256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 579/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:41 2022] GET /identity/v3/projects/83e0c203e9b54dc5b7e557037aa86b77 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:42.065984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8908-668d-4451-beee-1995616a910f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:42.148842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:42.163618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8908-668d-4451-beee-1995616a910f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:42.196329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e2167-efd4-4287-a40e-a679d8fcba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:42.196964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e2167-efd4-4287-a40e-a679d8fcba56 None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:42.197241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e2167-efd4-4287-a40e-a679d8fcba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:42.197536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e2167-efd4-4287-a40e-a679d8fcba56 None admin] PATH_INFO: `/v3/projects/83e0c203e9b54dc5b7e557037aa86b77/users/0f68275bdd194c40b8988a36eee9765f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:42.199403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e2167-efd4-4287-a40e-a679d8fcba56 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e0c203e9b54dc5b7e557037aa86b77, user_id=0f68275bdd194c40b8988a36eee9765f, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:42.200809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e2167-efd4-4287-a40e-a679d8fcba56 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:42.213279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 574/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:46:42 2022] PUT /identity/v3/projects/83e0c203e9b54dc5b7e557037aa86b77/users/0f68275bdd194c40b8988a36eee9765f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:46:44.069888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328a91-7114-4664-9867-4f65f12b2c0f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:44.070417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328a91-7114-4664-9867-4f65f12b2c0f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:44.070417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328a91-7114-4664-9867-4f65f12b2c0f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:44.071770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 580/1154] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:44.076776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:44.077216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:44.077347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:44.095513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:44.096691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:44.160781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 575/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:44.424747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328a91-7114-4664-9867-4f65f12b2c0f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:44.511681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:44.525142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328a91-7114-4664-9867-4f65f12b2c0f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:44.557553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:44.558168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:44.558448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:44.558720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:44.568903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:44.573646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:44.574745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:44.575795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 581/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:44.580738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:44.654335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:44.677667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39095473-a847-49d0-a07f-f11dc675d3dc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:44.710486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:44.711095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:44.711380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:44.711659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:44.712313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:44.712618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:44.714058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:44.722047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 576/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:44.728256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:44.826190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c233-a872-4f9a-b732-7a4472a29d7a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:44.858533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:44.859151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:44.859432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:44.859707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] PATH_INFO: `/v3/users/0f68275bdd194c40b8988a36eee9765f` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:44.860812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=0f68275bdd194c40b8988a36eee9765f)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:44.862260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:44.863817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 582/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:44 2022] GET /identity/v3/users/0f68275bdd194c40b8988a36eee9765f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:44.870298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:44.965554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685519-caab-4186-9e9f-31e15a5d07fa None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:44.998272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:44.998884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:44.999162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:44.999431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:45.007562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:45.064151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:45.065588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:45.157726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 577/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:45.164132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:45.182720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:45.266877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8504b19-b0e9-41ac-94de-4d70b2a56eb4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:45.299899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef910-7c22-468c-a501-266ebc877da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:45.300513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef910-7c22-468c-a501-266ebc877da5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:45.300793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef910-7c22-468c-a501-266ebc877da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:45.301066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef910-7c22-468c-a501-266ebc877da5 None admin] PATH_INFO: `/v3/projects/83e0c203e9b54dc5b7e557037aa86b77` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:45.302208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef910-7c22-468c-a501-266ebc877da5 None admin] RBAC: Authorizing `identity:get_project(project_id=83e0c203e9b54dc5b7e557037aa86b77)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:45.303625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef910-7c22-468c-a501-266ebc877da5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:45.305210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 583/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:45 2022] GET /identity/v3/projects/83e0c203e9b54dc5b7e557037aa86b77 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:45.311209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:45.348889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:45.407373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d3e4-350c-4b35-895e-f9729af79d58 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:45.440017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:45.440615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:45.440893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:45.441166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:45.441909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=83e0c203e9b54dc5b7e557037aa86b77, user.id=0f68275bdd194c40b8988a36eee9765f) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:45.442216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:45.443649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1328319-7e0b-4005-9980-4aea409dddb7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:45.449132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 578/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:45 2022] GET /identity/v3/role_assignments?user.id=0f68275bdd194c40b8988a36eee9765f&scope.project.id=83e0c203e9b54dc5b7e557037aa86b77&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:47.337492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa73f8-2a7d-415f-99dd-6c70815f7d96 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:47.338091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa73f8-2a7d-415f-99dd-6c70815f7d96 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:47.338091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa73f8-2a7d-415f-99dd-6c70815f7d96 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:47.339371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 584/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:47.344862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:47.345249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:47.345460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:47.363568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:47.364806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:47.429155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 579/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:47.712370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa73f8-2a7d-415f-99dd-6c70815f7d96 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:47.794494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:47.810680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa73f8-2a7d-415f-99dd-6c70815f7d96 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:47.843201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:47.843781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:47.844057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:47.844326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:47.907867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:47.909307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:47.986784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:48.003063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 585/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:48.009561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:48.039289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:48.106054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbbab4-c0fd-402f-94b6-baf6ffb88b41 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:48.138312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:48.138949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:48.139226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:48.139494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:48.145911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:48.148093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-a0e2d007-e2bb-4f42-a03a-abe1e1a3cf0d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:48.158881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:48.160076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:46:48.160968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 580/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:46:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:48.165894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:48.263561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929972e-12e2-46f0-bb94-9e85c483827e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:48.295637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:48.296213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:48.296488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:48.296752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:48.297396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:48.297696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:48.299027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edfea-e4f1-4362-8203-534fd6999664 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:48.306407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 586/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 07:46:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:50.184132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060cbe-b4f6-4d57-90c3-9bca973c0141 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:50.184681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060cbe-b4f6-4d57-90c3-9bca973c0141 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:50.184681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060cbe-b4f6-4d57-90c3-9bca973c0141 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:50.186039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 581/1167] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:50.191227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f561c7-f9b9-4471-b118-0b9188e93293 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:50.191665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f561c7-f9b9-4471-b118-0b9188e93293 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:50.191771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f561c7-f9b9-4471-b118-0b9188e93293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:50.211167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-32f561c7-f9b9-4471-b118-0b9188e93293 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:50.212338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-32f561c7-f9b9-4471-b118-0b9188e93293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:50.253513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:50.277250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:50.546610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060cbe-b4f6-4d57-90c3-9bca973c0141 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:50.636979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:50.646497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060cbe-b4f6-4d57-90c3-9bca973c0141 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:50.678878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4212-a461-4e8c-9bec-6576befefbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:50.679462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4212-a461-4e8c-9bec-6576befefbf1 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:50.679738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4212-a461-4e8c-9bec-6576befefbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:50.680007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4212-a461-4e8c-9bec-6576befefbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:50.680663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b4212-a461-4e8c-9bec-6576befefbf1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:50.682037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b4212-a461-4e8c-9bec-6576befefbf1 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:50.697182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 582/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Aug 24 07:46:50 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:52.604663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a7b7-e9cb-43ad-8bc6-5f565766f903 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:52.605158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a7b7-e9cb-43ad-8bc6-5f565766f903 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:52.605158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a7b7-e9cb-43ad-8bc6-5f565766f903 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:52.606500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 588/1170] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:52.611756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:52.612126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:52.612314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:52.630627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:52.631815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:52.696257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 583/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:52.962420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a7b7-e9cb-43ad-8bc6-5f565766f903 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:53.059758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a7b7-e9cb-43ad-8bc6-5f565766f903 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:53.092755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617196-fe43-427a-84ea-3b8b6f194ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:53.093390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617196-fe43-427a-84ea-3b8b6f194ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:53.093669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617196-fe43-427a-84ea-3b8b6f194ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:53.093939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617196-fe43-427a-84ea-3b8b6f194ec4 None admin] PATH_INFO: `/v3/domains/8f397f86c50348799bfad70aa34a6624` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:53.103878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc617196-fe43-427a-84ea-3b8b6f194ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8f397f86c50348799bfad70aa34a6624)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:53.105325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc617196-fe43-427a-84ea-3b8b6f194ec4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:53.106877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 589/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 24 07:46:52 2022] GET /identity/v3/domains/8f397f86c50348799bfad70aa34a6624 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:53.112465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:53.189897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:53.209551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba615d9-47f5-4d1c-a137-598d07f8279c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:53.241088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bf80f-7a45-4435-8db2-c8efe25e47e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:53.241858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf80f-7a45-4435-8db2-c8efe25e47e5 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:53.242133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf80f-7a45-4435-8db2-c8efe25e47e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:53.242400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf80f-7a45-4435-8db2-c8efe25e47e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:53.243028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bf80f-7a45-4435-8db2-c8efe25e47e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:53.244430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bf80f-7a45-4435-8db2-c8efe25e47e5 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:53.269647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 584/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:46:53 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:55.179274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e4b6c-ecd8-461f-a92e-719bc20bd38f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:55.179796 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e4b6c-ecd8-461f-a92e-719bc20bd38f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:55.179796 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e4b6c-ecd8-461f-a92e-719bc20bd38f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:55.181135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 590/1174] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:55.186390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353f587-4437-4f28-8795-100c3d366fec None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:55.186760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353f587-4437-4f28-8795-100c3d366fec None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:55.186941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353f587-4437-4f28-8795-100c3d366fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:55.204391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b353f587-4437-4f28-8795-100c3d366fec None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:55.205584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b353f587-4437-4f28-8795-100c3d366fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:55.269012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 585/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:55.538924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e4b6c-ecd8-461f-a92e-719bc20bd38f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:55.578553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:55.637177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e4b6c-ecd8-461f-a92e-719bc20bd38f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:55.669957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f5c8-8240-4411-9833-2118608c0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:55.670563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f5c8-8240-4411-9833-2118608c0408 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:55.670839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f5c8-8240-4411-9833-2118608c0408 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:55.671109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f5c8-8240-4411-9833-2118608c0408 None admin] PATH_INFO: `/v3/domains/8f397f86c50348799bfad70aa34a6624` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:55.672183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97f5c8-8240-4411-9833-2118608c0408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8f397f86c50348799bfad70aa34a6624)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:55.673610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97f5c8-8240-4411-9833-2118608c0408 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:55.675131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 591/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 24 07:46:55 2022] GET /identity/v3/domains/8f397f86c50348799bfad70aa34a6624 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:55.681423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353f587-4437-4f28-8795-100c3d366fec None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:55.740896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:55.779045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353f587-4437-4f28-8795-100c3d366fec None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:55.811480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9625e36-cd63-4292-a681-e922631af131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:55.812014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9625e36-cd63-4292-a681-e922631af131 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:55.812288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9625e36-cd63-4292-a681-e922631af131 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:55.812554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9625e36-cd63-4292-a681-e922631af131 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:55.813177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9625e36-cd63-4292-a681-e922631af131 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:55.814608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9625e36-cd63-4292-a681-e922631af131 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:55.835217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 586/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:46:55 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:57.730729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302eff4-c3e2-4c1b-8867-e19147b52edd None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:57.731377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302eff4-c3e2-4c1b-8867-e19147b52edd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:57.731377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302eff4-c3e2-4c1b-8867-e19147b52edd None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:57.732672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 592/1178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:57.737869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:57.738299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:57.738398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:57.756211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:57.757402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:57.821714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 587/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:58.087972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302eff4-c3e2-4c1b-8867-e19147b52edd None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:58.185164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302eff4-c3e2-4c1b-8867-e19147b52edd None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:58.192103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:58.218190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:58.218808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:58.219085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:58.219356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:58.229125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:58.233827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:58.235011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:46:58.236144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 593/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:58.241245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:58.289315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:58.336544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41cc48-2803-4c93-8731-7e39762869a5 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:58.369641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:58.370237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:58.370511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:58.370779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:58.371421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:58.371716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:58.373054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:58.380720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 588/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:58.386431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:58.482565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6916a-3644-45ce-97c8-35d42ecbd0a5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:58.514609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:58.515209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:58.515480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:58.515748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] PATH_INFO: `/v3/users/fbf4ae028dc1431482d4ac75838478f7` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:58.528285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=fbf4ae028dc1431482d4ac75838478f7)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:58.529727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:58.531263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 594/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:58 2022] GET /identity/v3/users/fbf4ae028dc1431482d4ac75838478f7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:58.537488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:58.632494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd6b1-c669-4d5c-bb35-f05def40e873 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:58.644682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:58.665485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:58.666075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:58.666350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:58.666620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:58.730272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:58.731686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:58.825277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 589/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:46:58.831082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:58.855210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:58.926329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45c99-5149-4d65-b076-70ce28e1f8e0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:58.959354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7282d7-8fa3-499f-af42-8b7fe15396f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:58.959965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7282d7-8fa3-499f-af42-8b7fe15396f8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:58.960243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7282d7-8fa3-499f-af42-8b7fe15396f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:58.960514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7282d7-8fa3-499f-af42-8b7fe15396f8 None admin] PATH_INFO: `/v3/projects/ed6e0a60e7c2423faab258e771ef30ce` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:58.961625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7282d7-8fa3-499f-af42-8b7fe15396f8 None admin] RBAC: Authorizing `identity:get_project(project_id=ed6e0a60e7c2423faab258e771ef30ce)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:58.963038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7282d7-8fa3-499f-af42-8b7fe15396f8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:58.964633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 595/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:58 2022] GET /identity/v3/projects/ed6e0a60e7c2423faab258e771ef30ce => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:58.970642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:58.984120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:59.066144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec91d3-f389-4fa5-9911-ec6dd262b76b None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:59.098007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:59.099420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:59.099697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:59.099965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:59.100668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=ed6e0a60e7c2423faab258e771ef30ce, user.id=fbf4ae028dc1431482d4ac75838478f7) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:59.100970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:59.102416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1459e7e-1d2b-43f4-b970-c10dadfca592 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:59.107558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 590/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:58 2022] GET /identity/v3/role_assignments?user.id=fbf4ae028dc1431482d4ac75838478f7&scope.project.id=ed6e0a60e7c2423faab258e771ef30ce&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:00.951063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d414d25-fea5-4e72-b9e5-e1f3f14936d8 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:00.951634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d414d25-fea5-4e72-b9e5-e1f3f14936d8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:00.951634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d414d25-fea5-4e72-b9e5-e1f3f14936d8 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:00.952930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 596/1186] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:00.958142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:00.958555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:00.958688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:00.975955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:00.977125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:01.040671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 591/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:01.307714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d414d25-fea5-4e72-b9e5-e1f3f14936d8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:01.396308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.406000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d414d25-fea5-4e72-b9e5-e1f3f14936d8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:01.438971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:01.439588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:01.439867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:01.440139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:01.449937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:01.454538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:01.455643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:47:01.456557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 597/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:01.461677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:01.469755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.558844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939952aa-116f-442f-99b4-45396a2aa261 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:01.597280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:01.597904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:01.598185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:01.598453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:01.599607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:01.599905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:01.601300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:01.609367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 592/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:01.615640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:01.712314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f26e6-b6ac-4903-9b5b-24ff1fa76f06 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:01.744937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:01.745568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:01.745846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:01.746117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] PATH_INFO: `/v3/users/fbf4ae028dc1431482d4ac75838478f7` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:01.747211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] RBAC: Authorizing `identity:get_user(user_id=fbf4ae028dc1431482d4ac75838478f7)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:01.748617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:01.750189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 598/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:47:01 2022] GET /identity/v3/users/fbf4ae028dc1431482d4ac75838478f7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:01.755653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:01.820880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.853562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9926c-56c3-43bb-b4de-e584c7d7554f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:01.884971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83436d6a-2b28-4d6e-a53e-b4be85cf9947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:01.885610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83436d6a-2b28-4d6e-a53e-b4be85cf9947 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:01.885889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83436d6a-2b28-4d6e-a53e-b4be85cf9947 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:01.886169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83436d6a-2b28-4d6e-a53e-b4be85cf9947 None admin] PATH_INFO: `/v3/projects/ed6e0a60e7c2423faab258e771ef30ce` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:01.887261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83436d6a-2b28-4d6e-a53e-b4be85cf9947 None admin] RBAC: Authorizing `identity:get_project(project_id=ed6e0a60e7c2423faab258e771ef30ce)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:01.888670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83436d6a-2b28-4d6e-a53e-b4be85cf9947 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:01.890308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 593/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:47:01 2022] GET /identity/v3/projects/ed6e0a60e7c2423faab258e771ef30ce => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:01.896628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:01.918411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.992577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ee0d5-c5fd-459e-a9e3-08d9489900ab None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:02.025190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d1d0-049e-4afc-908e-dfc37714cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:02.025852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d1d0-049e-4afc-908e-dfc37714cb7c None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:02.026129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d1d0-049e-4afc-908e-dfc37714cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:02.026396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d1d0-049e-4afc-908e-dfc37714cb7c None admin] PATH_INFO: `/v3/projects/ed6e0a60e7c2423faab258e771ef30ce/users/fbf4ae028dc1431482d4ac75838478f7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:02.028238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d1d0-049e-4afc-908e-dfc37714cb7c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6e0a60e7c2423faab258e771ef30ce, user_id=fbf4ae028dc1431482d4ac75838478f7, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:02.029780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d1d0-049e-4afc-908e-dfc37714cb7c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:02.042893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 599/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:47:01 2022] PUT /identity/v3/projects/ed6e0a60e7c2423faab258e771ef30ce/users/fbf4ae028dc1431482d4ac75838478f7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:47:03.896917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f1a3-2bd1-4dc2-a99f-12dee911178a None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:03.897731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f1a3-2bd1-4dc2-a99f-12dee911178a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:03.897923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f1a3-2bd1-4dc2-a99f-12dee911178a None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:03.899089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 594/1193] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:03.904317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:03.904749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:03.904844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:03.923377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:03.924538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:03.988605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 600/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:04.251549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544f1a3-2bd1-4dc2-a99f-12dee911178a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:04.352660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544f1a3-2bd1-4dc2-a99f-12dee911178a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:04.385154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:04.385796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:04.386070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:04.386339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:04.388852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:04.397510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:04.402097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:04.403196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:47:04.404251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 595/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:04.409376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:04.420807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:04.506268 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b02ef5-7ecc-47e9-b1d0-a06e57bd44fb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:04.539077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:04.539665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:04.539947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:04.540220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:04.540866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:04.541165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:04.542549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:04.550301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 601/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:04.555945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:04.651836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a414fc-054e-4298-848b-d8a2e967527a None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:04.683924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:04.684522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:04.684794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:04.685059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] PATH_INFO: `/v3/users/fbf4ae028dc1431482d4ac75838478f7` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:04.686171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] RBAC: Authorizing `identity:get_user(user_id=fbf4ae028dc1431482d4ac75838478f7)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:04.687573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:04.689084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 596/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 07:47:04 2022] GET /identity/v3/users/fbf4ae028dc1431482d4ac75838478f7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:04.695247 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:04.763126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:04.792202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0b3c-9e2e-49ea-9929-abf473fcefee None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:04.825017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:04.825622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:04.825905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:04.826161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:04.890859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:04.892278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:04.956908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:04.985591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 602/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:47:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:47:04.991906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:05.050905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:05.086940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49393-9e4e-4bb9-b09b-1575234913c6 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:05.119099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda8d6b-8dc3-41b6-9c08-2200d2bbdbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:05.119704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8d6b-8dc3-41b6-9c08-2200d2bbdbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:05.119978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8d6b-8dc3-41b6-9c08-2200d2bbdbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:05.120245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8d6b-8dc3-41b6-9c08-2200d2bbdbe3 None admin] PATH_INFO: `/v3/projects/ed6e0a60e7c2423faab258e771ef30ce` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:05.121336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda8d6b-8dc3-41b6-9c08-2200d2bbdbe3 None admin] RBAC: Authorizing `identity:get_project(project_id=ed6e0a60e7c2423faab258e771ef30ce)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:05.122742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda8d6b-8dc3-41b6-9c08-2200d2bbdbe3 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:05.124317 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 597/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 07:47:04 2022] GET /identity/v3/projects/ed6e0a60e7c2423faab258e771ef30ce => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:05.130425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:05.224736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6f774-f0ba-46da-8518-349730088ea7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:05.257068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:05.257682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:05.257956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:05.258223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:05.258918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=ed6e0a60e7c2423faab258e771ef30ce, user.id=fbf4ae028dc1431482d4ac75838478f7) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:05.259216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:05.260606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3041f30-575d-40c6-a161-c262a2a39e66 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:05.266171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 603/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:47:05 2022] GET /identity/v3/role_assignments?user.id=fbf4ae028dc1431482d4ac75838478f7&scope.project.id=ed6e0a60e7c2423faab258e771ef30ce&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:15.114775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=34 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:15.263645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=82 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:00.348437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979374-9b85-4643-8f06-deed5c79e680 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:00.348922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979374-9b85-4643-8f06-deed5c79e680 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:00.349009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979374-9b85-4643-8f06-deed5c79e680 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:00.350360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 598/1201] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:00.356157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:00.356666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:00.356666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:00.376189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:00.377419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:00.454665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 604/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:00.736640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979374-9b85-4643-8f06-deed5c79e680 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:00.861095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979374-9b85-4643-8f06-deed5c79e680 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:00.906998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:00.907674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:00.909462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:00.909781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:00.921377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:00.922826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:00.941044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:00.942420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:00.943481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:00.943481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:00.943481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:00.945842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 599/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:00.952341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:01.089488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e852f-4f58-4009-936d-ae1137328d20 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:01.122832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:01.130995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:01.131599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:01.132012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:01.132320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:01.132967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:01.133283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:01.134877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031ffc-d190-4fa8-a9f8-bbfa323cbb84 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:01.147949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 605/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:01.153721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:01.231912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:01.294727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d186c64-cba3-4504-bdb0-097f04ae4930 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:01.362712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed44df-f7e4-49d9-a268-c8bec98b7493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:01.363446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed44df-f7e4-49d9-a268-c8bec98b7493 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:01.363748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed44df-f7e4-49d9-a268-c8bec98b7493 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:01.364060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed44df-f7e4-49d9-a268-c8bec98b7493 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:01.364710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed44df-f7e4-49d9-a268-c8bec98b7493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:01.366458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed44df-f7e4-49d9-a268-c8bec98b7493 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:01.390956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 600/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 07:48:01 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:48:03.601132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ccf3-550c-4e13-903b-3f6597f62fe8 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:03.601770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ccf3-550c-4e13-903b-3f6597f62fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:03.601770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ccf3-550c-4e13-903b-3f6597f62fe8 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:03.603151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 606/1206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:03.609074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:03.609569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:03.609667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:03.628586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:03.629892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:03.702531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 601/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:03.969350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ccf3-550c-4e13-903b-3f6597f62fe8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:04.097380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ccf3-550c-4e13-903b-3f6597f62fe8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:04.138691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:04.139355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.139621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.139881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.150751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:48:04.155493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:04.156862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:48:04.158134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:04.161978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 607/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:48:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:48:04.163394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:04.209952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:04.282611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba0df8-b421-4f78-ad1e-fb9351995bbe None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:04.323868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:04.324750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.325026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.325321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.325983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:04.326282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:04.327641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:04.337545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 602/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:04.344089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:04.408412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:04.471078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2475-4760-4d69-8696-58d13e8ced8e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:04.513672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:04.514340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.514609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.514889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.538172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:04.538997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:04.556139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:04.565857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:04.567073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:04.567073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:04.567073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:04.567073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 608/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:48:04.567352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:04.677583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:04.681127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5a14-c0a8-41f4-b454-30f33bc26de7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:04.726623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:04.727250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.727510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.728046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.728886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:04.729242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:04.730773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:04.744512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 603/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:04.750408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:04.870110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69b29-a89b-40fe-ac84-c78894132ad6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:04.870865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:04.911552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:04.912474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.912915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.913371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.921569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:04.925537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:48:04.939246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:04.940875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:04.942407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 609/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:04.946985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:05.064451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6b054-1fd4-4353-8cd3-3b2bfd47ee36 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:05.108877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:05.109619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:05.109978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:05.110290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:05.111117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:05.111503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:05.113646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:05.139184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 604/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 07:48:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:05.140298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:05.271734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576bb4-72b1-4131-9180-4e8f6e40c201 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:05.310531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:05.311141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:05.311417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:05.311691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:05.349307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:05.395562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:05.397460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:05.519360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 610/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:48:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:48:05.520669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:05.543499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:05.633081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb484066-a5f7-4ddf-a370-a96f21318e48 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:05.671222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:05.671967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:05.672158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:05.672460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:05.685396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:05.686862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:05.703177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:05.704279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:05.705212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:05.705212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:05.705212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:05.710074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 605/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:05.711300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:05.785725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:05.833036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72ab1-b5dd-40d2-80fc-a2d63fe1c919 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:05.868558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:05.869163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:05.869481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:05.869775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:05.870388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:05.870671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:05.872087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:05.883870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 611/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:05.889711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:05.974018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:06.006029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e5e2-3def-4cca-bafb-1f2327aa3405 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:06.042696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:06.043345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:06.043620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:06.043888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:06.050947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:06.052415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:48:06.063559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:06.064908 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:06.065965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 606/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:06.070718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:06.178748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61f15f-1acc-4348-b9f3-c4c4146067fd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:06.202777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:06.217321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:06.217930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:06.218280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:06.218502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:06.219221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:06.219522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:06.221039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8efd4-e6d4-4bd6-8cb4-8b9ebee11134 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:06.239394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 612/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:06.240888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:06.352101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949894ca-1ac6-499c-94d5-d7e61e3ec761 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:06.382351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:06.389212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:06.389980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:06.390379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:06.390747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:06.391586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8e9e01118c984c2b895bad9d696d586b) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:06.392004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:06.393614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdd2a3-66e4-4fe4-850e-e59fb54f0a0e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:06.409525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 607/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:48:06 2022] GET /identity/v3/role_assignments?user.id=8e9e01118c984c2b895bad9d696d586b&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:08.423635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d283-8f74-4ccc-81f3-c08f05c48bac None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:08.424162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d283-8f74-4ccc-81f3-c08f05c48bac None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:08.424162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d283-8f74-4ccc-81f3-c08f05c48bac None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:08.425538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 613/1220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:48:08.430695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:08.431110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:08.431252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:08.450128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:08.451341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:08.522776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 608/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:08.797450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d283-8f74-4ccc-81f3-c08f05c48bac None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:08.911062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d283-8f74-4ccc-81f3-c08f05c48bac None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:08.948344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:08.948942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:08.949219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:08.949600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:08.960116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:48:08.964818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:08.965859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:08.966729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 614/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:48:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:08.972110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:09.078625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa9e2-dbd7-4575-bf90-b51e21d411f4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:09.103100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:09.117340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:09.118089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.118357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.118648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:09.119313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] RBAC: Adding query filter params (name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:09.119603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:09.120967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:09.130589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 609/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:09.136498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:09.183082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:09.245087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67eba7-b6d4-4bcc-9c53-a9798ab4420f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:09.280630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:09.281527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.281829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.282158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:09.295022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:09.296459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:09.313930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:09.315169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:09.316081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:09.316081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:09.316081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:09.316081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 615/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:09.321611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:09.441305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde15b1-de20-49b9-807d-3929c697d02d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:09.478842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:09.479631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.479929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.480203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:09.480943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:09.481243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:09.482860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:09.496564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 610/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:09.502687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:09.600891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:09.608033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004b48-dccb-456b-9c36-b5afd45c65e0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:09.642364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:09.642965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.643777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.644068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:09.651798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:09.653331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:48:09.665594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:09.666734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:09.667703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 616/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:09.673079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:09.723871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:09.795278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a3843-cf95-46fc-abb3-cf86ba8af750 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:09.834911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:09.835514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.835788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.836055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:09.836830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:09.837174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:09.838711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:09.856432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 611/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 07:48:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:09.862295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:09.968684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36347e-e16b-405f-b38f-25dfd32b5538 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.009198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.009916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.010193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.010461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.024705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.026296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:10.041566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:10.042744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:10.043885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:10.043885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:10.043885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:10.043885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 617/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:10.048996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.168069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523789b-9091-40cd-b7e3-36aadc6b77f8 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.171328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:10.206900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.207605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.207968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.208369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.209390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:10.209918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.211754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.226421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 612/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:10.233217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.244829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:10.349414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e6e06-de37-45c2-ad48-b82ea4682490 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.387759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.388397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.388729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.388991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.396111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.397873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:48:10.409125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:10.415411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:10.416573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 618/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:10.417181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.523709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7059ca-8e9f-402f-ad42-04a5d01cd019 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.560128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.560740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.561020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.561328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.562017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:10.562319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.563741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a17bd-5bad-478f-b962-2a6fef02cafd None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.576519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 613/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:10.582924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.656005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:10.694551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7121-8f41-4395-be52-037e79ba3662 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.735049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ca76f-f2e5-479f-806f-5eb59a4890f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.735711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca76f-f2e5-479f-806f-5eb59a4890f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.735996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca76f-f2e5-479f-806f-5eb59a4890f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.736272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca76f-f2e5-479f-806f-5eb59a4890f5 None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8e9e01118c984c2b895bad9d696d586b/roles/204e9f89cd0b491681a48aab356cffee` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.753428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ca76f-f2e5-479f-806f-5eb59a4890f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=8e9e01118c984c2b895bad9d696d586b, role_id=204e9f89cd0b491681a48aab356cffee)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.754893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ca76f-f2e5-479f-806f-5eb59a4890f5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.767910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 619/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:48:10 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8e9e01118c984c2b895bad9d696d586b/roles/204e9f89cd0b491681a48aab356cffee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:48:12.768914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422ccd-b95d-4cfe-95ce-b0252ea9215c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:12.769493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422ccd-b95d-4cfe-95ce-b0252ea9215c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:12.769493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422ccd-b95d-4cfe-95ce-b0252ea9215c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:12.770953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 614/1233] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:12.777486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:12.777930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:12.778026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:12.800624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:12.801893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:12.879817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 620/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:13.180440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422ccd-b95d-4cfe-95ce-b0252ea9215c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:13.205558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:13.295746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422ccd-b95d-4cfe-95ce-b0252ea9215c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:13.331845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:13.332469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:13.332745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:13.333012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:13.344737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:48:13.350398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:13.351424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:13.352889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 615/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 07:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:13.357429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:13.406854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:13.464797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc5fb7-e80a-48a8-912f-3e7f3e6b6efb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:13.501138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:13.501800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:13.502077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:13.502380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:13.503052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:13.503387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:13.504829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:13.514297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 621/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 07:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:13.520828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:13.611809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:13.631255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952842a-6906-4b44-b6d5-4945e390140c None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:13.668636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:13.669319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:13.669605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:13.669877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:13.681539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:13.682986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:13.697441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:13.698617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:13.699729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:13.699729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:13.699729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:13.699729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 616/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:13.704746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:13.816456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636ed4-57ec-40ea-a978-bfc1b73411f3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:13.826878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:13.857462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:13.858078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:13.858359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:13.858630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:13.859300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:13.859569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:13.860930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:13.873968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 622/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:13.880756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:13.996521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef774208-a4ae-488b-951a-7dc97c9311d9 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:14.041025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:14.041915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:14.042254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:14.042676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:14.045807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:14.052082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:14.054234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:48:14.067622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:14.068809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:14.069808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 617/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:14.074544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:14.185966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf41db-554b-4a7c-b5b1-6eebdec10516 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:14.225381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:14.226043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:14.226319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:14.226583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:14.227324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:14.227686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:14.229133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:14.247450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 623/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 07:48:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:14.254214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:14.370955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f20eaa-df75-4970-a593-d68090fe6953 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:14.406509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:14.407117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:14.407396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:14.407668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:14.476325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:14.483237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:14.484713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:14.592451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 618/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:48:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:14.599106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:14.632340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:14.717520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368e73b-d4c8-49f4-8670-77ccf3f75ec2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:14.758435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:14.759237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:14.759620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:14.759991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:14.774132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:14.775580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:14.792186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:14.793780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:14.794982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:14.794982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:14.794982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:14.794982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 624/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:14.800227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:14.908423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:14.917406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d6329-f58d-496f-86e2-fba179f5bdf0 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:14.952910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:14.953554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:14.953830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:14.954097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:14.954722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:14.955047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:14.956944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:14.968508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 619/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:14.977033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:15.061826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:15.089153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c99fe2-315e-44fa-9f1c-48e5cda55c63 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:15.125411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:15.126123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:15.126394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:15.126662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:15.135967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:15.137440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:48:15.150035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:15.151104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:15.152063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 625/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:15.157848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:15.264854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47a08-ac09-44c1-a9a6-11aac89af63e None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:15.303471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:15.304237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:15.304523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:15.304805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:15.305647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:15.305975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:15.307410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85e837-256c-4552-a8b7-58ad1a205781 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:15.319733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 620/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:15.326456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:15.441735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3cbb-b75e-48ec-b85c-461da6b3fe46 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:15.478431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:15.479038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:15.479319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:15.479590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:15.480301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] RBAC: Adding query filter params (role.id=204e9f89cd0b491681a48aab356cffee, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8e9e01118c984c2b895bad9d696d586b) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:15.480606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:15.482116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46c162-b21f-4cb2-879a-cde5abbb5990 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:15.488462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 626/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:48:15 2022] GET /identity/v3/role_assignments?user.id=8e9e01118c984c2b895bad9d696d586b&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=204e9f89cd0b491681a48aab356cffee => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:17.530526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad405a1-e28b-4e45-8c9b-23d5aa05eca0 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:17.531116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad405a1-e28b-4e45-8c9b-23d5aa05eca0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:17.531116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad405a1-e28b-4e45-8c9b-23d5aa05eca0 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:17.532821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 621/1247] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:17.538614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:17.539103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:17.539208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:17.545665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:17.559208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:17.560426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:17.633472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 627/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:48:17.942824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad405a1-e28b-4e45-8c9b-23d5aa05eca0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:17.963686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.057451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad405a1-e28b-4e45-8c9b-23d5aa05eca0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:18.101026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:18.101699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:18.101978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:18.102251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:18.115169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:48:18.119923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:18.121714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:18.123294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 622/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:18.127141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:18.232023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60658-ffff-4677-9372-9d7e8c144e07 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:18.265737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.271768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:18.272623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:18.272900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:18.273179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:18.273837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:18.274133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:18.275482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:18.287418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 628/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:18.293311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:18.394947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.420461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245657c8-7798-442a-8c4d-4b90998cef94 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:18.456789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:18.457610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:18.457989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:18.458307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:18.469036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:18.470605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:18.485801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:18.487754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:18.488662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:18.488662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:18.488662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:18.488662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 623/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:18.494152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:18.617992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43098d-85fb-4b84-a8ed-1505841a1e66 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:18.658393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:18.659018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:18.659301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:18.659575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:18.660216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:18.660516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:18.661912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:18.673843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 629/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:18.680142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:18.783113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ce997-f6f3-4d85-b39a-d429a1e22725 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:18.815931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.824871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:18.825677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:18.826082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:18.826361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:18.835194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:18.836914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:48:18.850005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:18.851156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:18.852334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:18.856621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 624/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:18.857578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:18.918679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.968443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e9ae-cf14-4761-bb8a-c6c75c6d4297 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:19.005128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:19.007257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.007257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.007257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.007257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:19.007732 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:19.009427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:19.028805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 630/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 07:48:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:19.035289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:19.139452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433dc5-8bc3-453d-9551-089637d2038f None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:19.175629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:19.176419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.176803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.177149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.232699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:19.246859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:19.248371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:19.360230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 625/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:48:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:19.361513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:19.467047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e144b1-060c-4dc4-abe9-039eb352fae9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:19.481931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:19.504491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:19.505111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.505422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.505686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.516136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:19.517618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:19.534644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:19.535833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:19.536955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:19.536955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:19.536955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:19.536955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 631/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:19.541713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:19.636938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:19.650937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13d09-99d7-45ba-97fb-049408f8ddec None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:19.687270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:19.687931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.688149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.688415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.689064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:19.689399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:19.690795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:19.703215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 626/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:19.709615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:19.818513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249a1df-1675-45a4-bec2-75fd57ca55c0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:19.858002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:19.858652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.858959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.859207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.866871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:19.868330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:48:19.881367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:19.882552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:19.883678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:19.884390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 632/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:19.888568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:19.992779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b061ee-0fca-4625-8ffa-5e67cb3a3439 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:20.028547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:20.029283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:20.029575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:20.029849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:20.030550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:20.030856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:20.032296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625e6cb-da9f-483c-8b3c-b2b6263289e0 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:20.046448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 627/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:20.052560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:20.078841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:20.157571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bf3dc-4c91-4032-9021-8fe6ab6590ba None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:20.191714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:20.192313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:20.192595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:20.192866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:20.193614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8e9e01118c984c2b895bad9d696d586b) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:20.193915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:20.195333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7eb63-a1b8-491a-8d90-7e2dc2e628f6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:20.200837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 633/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:48:20 2022] GET /identity/v3/role_assignments?user.id=8e9e01118c984c2b895bad9d696d586b&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:22.062303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1824fe-d0a1-4c60-849e-918f5db7c1ac None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.062833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1824fe-d0a1-4c60-849e-918f5db7c1ac None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.062833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1824fe-d0a1-4c60-849e-918f5db7c1ac None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.064183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 628/1261] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:22.069302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.069669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.069868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.087659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:22.088846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:22.153393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 634/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:22.418066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1824fe-d0a1-4c60-849e-918f5db7c1ac None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:22.428767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:22.515200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1824fe-d0a1-4c60-849e-918f5db7c1ac None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:22.548071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:22.548672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.548971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.549237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.558986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:48:22.563547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:22.564648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:22.565694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 629/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:22.570418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:22.588518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:22.666777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd63f9-f645-46b2-a2e2-79e770744a7d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:22.698822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:22.699412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.699694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.699968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.700613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:22.700914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:22.702295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:22.710542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 635/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:22.715991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:22.780835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:22.821807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943e49-5672-4685-82b9-ebe4ae61a952 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:22.858804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:22.859407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.859685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.859955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.869810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:22.871229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:22.885678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:22.886804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:22.887930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:22.887930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:22.887930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:22.887930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 630/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:22.894698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:22.974445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:22.993217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27045f-49de-4b38-a726-39220dea6aa0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.026716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.027305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.027587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.027860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.028491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:23.028793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.030176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.042332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 636/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:23.047967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:23.145881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f1eda-1499-48ce-ac58-1ab98370ae01 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.165174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.179492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.180107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.180384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.180654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.187380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.188806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:48:23.200357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:23.201500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:23.202715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 631/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:23.207190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:23.302900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb225b-acda-4092-b3d4-566afbc2e9fe None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.335395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.335984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.336265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.336536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.337252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:23.337579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.338998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.347734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.356791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 637/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 07:48:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:23.362940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:23.458092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75009-04fa-47b1-93d1-c4ef5cc0f5d7 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.490620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.491218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.491491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.491761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.501730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.503171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:23.516430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:23.517560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:23.518733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:23.518733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:23.518733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:23.518733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 632/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:23.523434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:23.618181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a6c7-7f6a-4f00-8597-d59b65ea3aee None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.649972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.650556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.650830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.651095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.651711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:23.652006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.653362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.664505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 638/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:23.670055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:23.700784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.765967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b51fc-fcf7-4e52-91f9-c5cbb7268b95 None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.800827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.801481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.801758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.802031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.808662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.810199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:48:23.825475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:23.826443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:23.827409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 633/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:23.833092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:23.890031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.931628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760796-d5d8-4b92-8313-a11b4c63d12c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:23.964256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:23.964858 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.965141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.965449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.966135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:23.966439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:23.967865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5a76-4221-4251-bcf3-8908d6948a69 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:23.980222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 639/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:23.986401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:24.081840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:24.090327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a92ea-04b7-4d05-97b9-4661763a5d0d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:24.122702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf048f59-3244-423e-9e90-4d1732e83fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:24.123345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf048f59-3244-423e-9e90-4d1732e83fbb None admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:24.123622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf048f59-3244-423e-9e90-4d1732e83fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:24.123894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf048f59-3244-423e-9e90-4d1732e83fbb None admin] PATH_INFO: `/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8e9e01118c984c2b895bad9d696d586b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:24.125763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf048f59-3244-423e-9e90-4d1732e83fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d17bd537b5446aabfb9fc6d2c89186, user_id=8e9e01118c984c2b895bad9d696d586b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:24.127209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf048f59-3244-423e-9e90-4d1732e83fbb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:24.138991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 634/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 07:48:23 2022] PUT /identity/v3/projects/e8d17bd537b5446aabfb9fc6d2c89186/users/8e9e01118c984c2b895bad9d696d586b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:48:25.995764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2145870-f5e0-4117-99c7-04190260feff None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:25.996330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2145870-f5e0-4117-99c7-04190260feff None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:25.996330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2145870-f5e0-4117-99c7-04190260feff None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:25.997688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 640/1274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:26.002818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:26.003237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:26.003348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:26.020895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:26.022358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:26.087043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 635/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:48:26.355612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2145870-f5e0-4117-99c7-04190260feff None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:26.452773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2145870-f5e0-4117-99c7-04190260feff None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:26.469730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:26.486601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:26.487212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:26.487489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:26.487757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:26.497493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:48:26.502589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:26.503693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:26.504750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 641/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 07:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:26.511684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:26.591462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:26.609587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a6ff-f8bb-484f-8544-4192ef1d4c13 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:26.641825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:26.642414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:26.643226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:26.643495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:26.644134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:26.644429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:26.645799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:26.653752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 636/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 07:48:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:26.659529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:26.757064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4ae02-e484-40ba-84a5-30def9be5109 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:26.791437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:26.792176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:26.792504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:26.792807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:26.803190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:26.804645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:26.821381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:26.823083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:26.824483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:26.824483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:26.824483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:26.824483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 642/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:26.828807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:26.930211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447c209-4c0e-4dfc-ac3e-ee8f761317df None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:26.962489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:26.963082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:26.963362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:26.963638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:26.964267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:26.964567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:26.965940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:26.977132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 637/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:26.982775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.013423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.080526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c258f-72d8-4774-8ff5-0e00ab609b66 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:27.112605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:27.113210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.113521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.113789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] PATH_INFO: `/v3/users/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.120865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:27.122299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:48:27.133529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:27.134770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:27.135894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 643/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:27.140269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.144035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.237552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734caec-6ae2-4789-b992-1ce4250989bb None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:27.269623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:27.270217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.270499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.270793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.271491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:27.271794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:27.273494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:27.290286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 638/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 07:48:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:27.295934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.383693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.393518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf0020-1ea7-4e2c-8ce2-8643d95415df None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:27.426361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:27.426944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.427217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.427484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.490997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:27.492356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:27.575644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.586524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 644/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 07:48:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:27.592339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.651729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.689156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e4e8-0ba3-4e98-a2c7-dd3ad54350fa None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:27.722580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:27.723196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.723477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.723754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.733462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:27.734902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:48:27.748983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:27.750125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:48:27.751242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:48:27.751242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:48:27.751242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:27.751242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 639/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:27.755564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.850074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913967-ea2f-4b07-9010-eabc03f0ab5f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:27.882371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:27.882950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.883224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.883492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.884106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:27.884400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:27.885766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:27.896826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 645/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 07:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:27.902487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.999436 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0786fc-e318-438f-b609-7817e4eba2bc None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:28.012780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:28.032929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:28.033597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:28.033877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:28.034148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:28.040464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:28.041924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:48:28.052654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:28.053743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: ERROR keystone.server.flask.application Aug 24 07:48:28.055008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 640/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 07:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:28.059436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:28.108402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:28.156267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b2e4a-e26a-4514-a1df-03a9fbb6719d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:28.187885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:28.188477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:28.188753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:28.189022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:28.190230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:28.190527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:28.191927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79955f77-7bf0-4910-a132-df20a78f75bf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:28.203624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 646/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 07:48:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:28.210342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:28.305701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c06c6-8ffa-41c8-9b05-f5ca200ec8da None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:28.338186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:28.338780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:28.339064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:28.339333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:28.340040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] RBAC: Adding query filter params (role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3, scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186, user.id=8e9e01118c984c2b895bad9d696d586b) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:28.340344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:28.341791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3041-320e-416f-9093-28de307a9895 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:28.347693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 641/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 07:48:28 2022] GET /identity/v3/role_assignments?user.id=8e9e01118c984c2b895bad9d696d586b&scope.project.id=e8d17bd537b5446aabfb9fc6d2c89186&role.id=df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:30.219701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582e40-0401-410a-94f0-4f7135ecc96d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:30.220330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582e40-0401-410a-94f0-4f7135ecc96d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:30.220330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582e40-0401-410a-94f0-4f7135ecc96d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:30.222106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 647/1288] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:30.227320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:30.227718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:30.227863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:30.246096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:30.247268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:30.275626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:30.312076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 642/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:30.578289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582e40-0401-410a-94f0-4f7135ecc96d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:30.677461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582e40-0401-410a-94f0-4f7135ecc96d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:30.687644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:30.710898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:30.711508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:30.711787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:30.712057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:30.712631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:30.714012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:30.722421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:30.723719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:30.724999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 648/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:48:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:30.729342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:30.831153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700c74c-e7cd-42a8-891b-58e55a826771 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:30.865051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:30.865676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:30.865956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:30.866227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:30.866843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:30.867144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:30.868501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ef58-ce75-45cb-a3b9-eb7156523172 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:30.873144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 643/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:30.879550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:30.976759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad9f17-6abe-4fa2-b283-506ada19e5ef None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:31.008999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:31.009608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:31.009887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:31.010157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:31.010763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:31.011060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:31.012405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af020f-2fed-4051-9f31-22ef62d85166 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:31.016649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 649/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:32.861842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cb2a9-91f4-4c4e-8df2-367d04c2e4d7 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:32.862392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cb2a9-91f4-4c4e-8df2-367d04c2e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:32.862392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cb2a9-91f4-4c4e-8df2-367d04c2e4d7 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:32.863722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 644/1293] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:32.868767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df43bad-b0c1-41df-9441-1f324ddbe596 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:32.869150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df43bad-b0c1-41df-9441-1f324ddbe596 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:32.869349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df43bad-b0c1-41df-9441-1f324ddbe596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:32.886752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3df43bad-b0c1-41df-9441-1f324ddbe596 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:32.887916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3df43bad-b0c1-41df-9441-1f324ddbe596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:32.919130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:32.955127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 650/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:33.225510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cb2a9-91f4-4c4e-8df2-367d04c2e4d7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:33.255862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:33.324109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cb2a9-91f4-4c4e-8df2-367d04c2e4d7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:33.365339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf2cfb-2e7d-429b-a628-891167258791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:33.365942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf2cfb-2e7d-429b-a628-891167258791 None admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:33.366222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf2cfb-2e7d-429b-a628-891167258791 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:33.366495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf2cfb-2e7d-429b-a628-891167258791 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:33.371001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf2cfb-2e7d-429b-a628-891167258791 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:33.372358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf2cfb-2e7d-429b-a628-891167258791 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:33.389685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 645/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 07:48:33 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:48:35.262933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4c2d-3626-4bab-85e0-cc3aa8b7dbd0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:35.263483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4c2d-3626-4bab-85e0-cc3aa8b7dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:35.263483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4c2d-3626-4bab-85e0-cc3aa8b7dbd0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:35.264804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 651/1296] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:35.270134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:35.270522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:35.270678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:35.288567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:35.289767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:35.360339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 646/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:35.623737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4c2d-3626-4bab-85e0-cc3aa8b7dbd0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:35.722047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4c2d-3626-4bab-85e0-cc3aa8b7dbd0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:35.754712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:35.755328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:35.755610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:35.755885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:35.756462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:35.757851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:35.766262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:35.767465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:35.768521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 652/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:48:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:35.773475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:35.793773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:35.888452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0f90b-c8ef-4212-bd12-2464babd2c43 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:35.921653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:35.922253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:35.922531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:35.922801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:35.923459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:35.923759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:35.925108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:35.930091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 647/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:48:35.936066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:35.967794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:36.034830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a76eb-e314-4ae3-912e-d78c97215a9e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:36.066502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:36.067087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:36.067365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:36.067636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:36.068331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] RBAC: Adding query filter params (interface=public, service_id=9f92aed4a8044d6e9339005fb53c42db, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:36.068636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:36.070007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009ef9-2484-4ba3-9997-e13ec33e96c4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:36.074814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 653/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 07:48:35 2022] GET /identity/v3/endpoints?service_id=9f92aed4a8044d6e9339005fb53c42db&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:36.081028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:36.175284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:36.193237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083119-fe97-4c92-8f0c-c1b3acf3e19d None admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:36.226146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf51167-898f-4f66-a9a4-c2f4cd145a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:36.226741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf51167-898f-4f66-a9a4-c2f4cd145a49 None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:36.227018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf51167-898f-4f66-a9a4-c2f4cd145a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:36.227289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf51167-898f-4f66-a9a4-c2f4cd145a49 None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:36.227889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf51167-898f-4f66-a9a4-c2f4cd145a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:36.229234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf51167-898f-4f66-a9a4-c2f4cd145a49 None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:36.235826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 648/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 07:48:36 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:48:38.124133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81274c-fb82-4a1e-a573-ae09f3aca0f3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:38.124688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81274c-fb82-4a1e-a573-ae09f3aca0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:38.124688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81274c-fb82-4a1e-a573-ae09f3aca0f3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:38.126031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 654/1302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:38.131841 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:38.132286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:38.132389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:38.150816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:38.152009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:38.216708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 649/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:38.483933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81274c-fb82-4a1e-a573-ae09f3aca0f3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:38.577590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:38.584758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81274c-fb82-4a1e-a573-ae09f3aca0f3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:38.618439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:38.619053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:38.619334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:38.619607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:38.620185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:38.621563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:38.630136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:38.631438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: ERROR keystone.server.flask.application Aug 24 07:48:38.632531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 655/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 07:48:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:38.637249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:38.710810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:38.734242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26221f2-5595-466d-ac0b-168db7924a0d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:38.766848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:38.767633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:38.767917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:38.768191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] PATH_INFO: `/v3/services` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:38.768810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:38.769111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:38.770492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf53dd-8856-4ce3-b381-4435fd50ac3d None admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:38.775673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 650/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:38.781290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:38.894218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aef72-5600-44b6-9787-445c0e3dfe0e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:38.926941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30ad8-3c15-4f37-b4ad-4c3833884857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:38.927538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30ad8-3c15-4f37-b4ad-4c3833884857 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:38.927819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30ad8-3c15-4f37-b4ad-4c3833884857 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:38.928174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30ad8-3c15-4f37-b4ad-4c3833884857 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:38.928843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30ad8-3c15-4f37-b4ad-4c3833884857 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:38.930230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30ad8-3c15-4f37-b4ad-4c3833884857 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:38.950518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 656/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:48:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:48:48.772835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=30 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:48.946315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.060616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621f8c-6a24-453c-aede-c36f2420aeb2 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.061698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621f8c-6a24-453c-aede-c36f2420aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.062263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621f8c-6a24-453c-aede-c36f2420aeb2 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.069686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe28f44-3b48-4503-9481-3053ff1407e8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.070103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe28f44-3b48-4503-9481-3053ff1407e8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.070518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe28f44-3b48-4503-9481-3053ff1407e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.072698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 651/1307] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:49:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:42.166496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-dfe28f44-3b48-4503-9481-3053ff1407e8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.168177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dfe28f44-3b48-4503-9481-3053ff1407e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.299589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 657/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:42.600694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee40bcf-cce2-42bb-b07a-57d95156fa43 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.600977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee40bcf-cce2-42bb-b07a-57d95156fa43 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.601556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee40bcf-cce2-42bb-b07a-57d95156fa43 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.603121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 652/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 24 07:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:42.609365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c038b6-bfe8-41df-a34e-356f4ae4ce71 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.610471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c038b6-bfe8-41df-a34e-356f4ae4ce71 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.611638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c038b6-bfe8-41df-a34e-356f4ae4ce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.700935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a0c038b6-bfe8-41df-a34e-356f4ae4ce71 None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.702461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a0c038b6-bfe8-41df-a34e-356f4ae4ce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.726050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.803952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee40bcf-cce2-42bb-b07a-57d95156fa43 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:42.806711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3ee40bcf-cce2-42bb-b07a-57d95156fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.810809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 658/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 24 07:49:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:42.935394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee40bcf-cce2-42bb-b07a-57d95156fa43 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.013546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.014166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.014445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.014714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.016380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:43.080504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.164074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.166425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91938ae1-33e5-4fbe-8782-fe8e79a99f1e service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.193700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 653/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:45.392862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b24f6-2c4a-43b2-af5b-eadbc1c353cf None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:45.393409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b24f6-2c4a-43b2-af5b-eadbc1c353cf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:45.393527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b24f6-2c4a-43b2-af5b-eadbc1c353cf None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:45.394827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 659/1312] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:45.400411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e644-9117-4cc7-a85c-88f0a4952b4a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:45.400840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e644-9117-4cc7-a85c-88f0a4952b4a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:45.401087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e644-9117-4cc7-a85c-88f0a4952b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:45.482004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1009e644-9117-4cc7-a85c-88f0a4952b4a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:45.483207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1009e644-9117-4cc7-a85c-88f0a4952b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:45.584156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 654/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:45.873795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e64fc-0ab1-42ed-b727-3e456a27cfa2 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:45.874109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e64fc-0ab1-42ed-b727-3e456a27cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:45.874382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e64fc-0ab1-42ed-b727-3e456a27cfa2 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:45.875816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 660/1314] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 24 07:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:45.881600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567272d8-a13c-4e47-a103-163063c0b91b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:45.881896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567272d8-a13c-4e47-a103-163063c0b91b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:45.882168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567272d8-a13c-4e47-a103-163063c0b91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:45.894919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:45.963419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-567272d8-a13c-4e47-a103-163063c0b91b None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:45.964634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-567272d8-a13c-4e47-a103-163063c0b91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:46.038377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 655/1315] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 24 07:49:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:46.047259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e64fc-0ab1-42ed-b727-3e456a27cfa2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:46.048762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ee8e64fc-0ab1-42ed-b727-3e456a27cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:46.151454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e64fc-0ab1-42ed-b727-3e456a27cfa2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:46.221542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:46.224327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:46.224940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:46.225432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:46.225751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:46.227726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:46.333166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:46.334709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa16f-2601-4266-8e60-c620e2be1c12 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:46.352977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 661/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:48.750557 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42df6-9897-4040-ad05-d6058cdfaf8c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.751086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42df6-9897-4040-ad05-d6058cdfaf8c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.751086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42df6-9897-4040-ad05-d6058cdfaf8c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.752443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 656/1317] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:48.757769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186629-1e97-4451-a3ff-a94f9a6c3db6 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.758165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186629-1e97-4451-a3ff-a94f9a6c3db6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.758317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186629-1e97-4451-a3ff-a94f9a6c3db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.823879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ef186629-1e97-4451-a3ff-a94f9a6c3db6 None None] MFA Rules not processed for user `252406ca8b22416f82b7bdbeb1bf87d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:48.825076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ef186629-1e97-4451-a3ff-a94f9a6c3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:48.875236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.919515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 662/1318] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:49.200194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d42df6-9897-4040-ad05-d6058cdfaf8c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.201760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-23d42df6-9897-4040-ad05-d6058cdfaf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:49.302774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d42df6-9897-4040-ad05-d6058cdfaf8c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.305500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.376522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.377121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.377431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.377699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.379265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:49.482799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.484205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a5de-7bb9-460a-9636-b8c6ff0e7e63 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.503870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 657/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:51.878542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdb8f1-46c3-438d-90d4-3c2708bc45be None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:51.879080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdb8f1-46c3-438d-90d4-3c2708bc45be None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:51.879080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdb8f1-46c3-438d-90d4-3c2708bc45be None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:51.880398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 663/1320] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:51.885758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001232f-e108-4991-977f-0989af3db85a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:51.886162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001232f-e108-4991-977f-0989af3db85a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:51.886295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001232f-e108-4991-977f-0989af3db85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:51.926577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:51.951251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1001232f-e108-4991-977f-0989af3db85a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:51.952440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1001232f-e108-4991-977f-0989af3db85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:52.047984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 658/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:52.327314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdb8f1-46c3-438d-90d4-3c2708bc45be None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:52.328837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-58bdb8f1-46c3-438d-90d4-3c2708bc45be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:52.429637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdb8f1-46c3-438d-90d4-3c2708bc45be None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:52.498984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:52.499576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:52.499899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:52.500657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:52.502243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:52.509390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:52.607891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:52.609799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38524405-f785-4331-adfa-1dda4a6b724a service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:52.627636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 664/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:55.156097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5ff5-0033-43e8-88c2-e8f243b72ba0 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.156638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5ff5-0033-43e8-88c2-e8f243b72ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.156638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5ff5-0033-43e8-88c2-e8f243b72ba0 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.158028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 659/1323] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:55.163230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b563-3b30-4d00-a55d-619f836cdbcc None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.163654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b563-3b30-4d00-a55d-619f836cdbcc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.163907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b563-3b30-4d00-a55d-619f836cdbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.228838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c284b563-3b30-4d00-a55d-619f836cdbcc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:55.230047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c284b563-3b30-4d00-a55d-619f836cdbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:55.286770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.327221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 665/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:55.606579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5ff5-0033-43e8-88c2-e8f243b72ba0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.608162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d89a5ff5-0033-43e8-88c2-e8f243b72ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:55.710526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5ff5-0033-43e8-88c2-e8f243b72ba0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.722386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.783413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.783940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.784220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.784486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.786115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:55.894930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.896381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0655e0d-e6a3-4f24-87e9-558c77a7f298 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.914475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 660/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:57.864280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe471-f9d7-4f9d-a18a-20cbdc1029cb None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.864824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe471-f9d7-4f9d-a18a-20cbdc1029cb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.864824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe471-f9d7-4f9d-a18a-20cbdc1029cb None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.866129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 666/1326] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:57.871567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6c09d-2b6e-4dc4-a4f4-ebefff30b765 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.872020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6c09d-2b6e-4dc4-a4f4-ebefff30b765 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.872234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6c09d-2b6e-4dc4-a4f4-ebefff30b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.920931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.939515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6fa6c09d-2b6e-4dc4-a4f4-ebefff30b765 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:57.940717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6fa6c09d-2b6e-4dc4-a4f4-ebefff30b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:58.039853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 661/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:58.319538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe471-f9d7-4f9d-a18a-20cbdc1029cb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.321158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-027fe471-f9d7-4f9d-a18a-20cbdc1029cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:58.426603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe471-f9d7-4f9d-a18a-20cbdc1029cb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.507510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.508124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.508400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.508678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.510275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:58.527387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:58.625477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.626910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec785a-1e09-45c5-b308-7da1f6843aeb service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.645532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 667/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:00.596407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6986a-301b-400a-b3aa-9a44f3a456e8 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:00.596923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6986a-301b-400a-b3aa-9a44f3a456e8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:00.597021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6986a-301b-400a-b3aa-9a44f3a456e8 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:00.598348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 662/1329] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:00.603601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ee7df-d628-4894-9960-0415ea1cbbfc None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:00.604096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ee7df-d628-4894-9960-0415ea1cbbfc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:00.604341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ee7df-d628-4894-9960-0415ea1cbbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:00.677085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f54ee7df-d628-4894-9960-0415ea1cbbfc None None] MFA Rules not processed for user `252406ca8b22416f82b7bdbeb1bf87d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:00.678346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f54ee7df-d628-4894-9960-0415ea1cbbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:00.741816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:00.775425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 668/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:01.057549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6986a-301b-400a-b3aa-9a44f3a456e8 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.059304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c3d6986a-301b-400a-b3aa-9a44f3a456e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:01.168505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6986a-301b-400a-b3aa-9a44f3a456e8 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:01.188575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:01.241450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:01.242050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.242326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.242594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.244181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:01.352232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:01.353721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54303-f402-45f8-8690-6e06118c6335 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:01.371778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 663/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:03.496990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8759a3-d124-4e87-8f6c-627b9bd50401 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:03.497605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8759a3-d124-4e87-8f6c-627b9bd50401 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:03.497605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8759a3-d124-4e87-8f6c-627b9bd50401 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:03.498890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 669/1332] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:03.504864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3882f-29c2-42c0-a8fa-c3df7ba0a2ad None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:03.505350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3882f-29c2-42c0-a8fa-c3df7ba0a2ad None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:03.505464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3882f-29c2-42c0-a8fa-c3df7ba0a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:03.567919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:03.571138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6ff3882f-29c2-42c0-a8fa-c3df7ba0a2ad None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:03.572636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6ff3882f-29c2-42c0-a8fa-c3df7ba0a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:03.666993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 664/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:03.945127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8759a3-d124-4e87-8f6c-627b9bd50401 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:03.946689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dd8759a3-d124-4e87-8f6c-627b9bd50401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:04.050765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8759a3-d124-4e87-8f6c-627b9bd50401 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:04.126181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:04.126815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:04.127093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:04.127363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:04.128954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:04.154917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:04.236436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:04.237844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8e52-2963-4797-93ab-b0efad1a86a8 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:04.255381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 670/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:06.191766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5238ae9-9b69-4627-8b39-c16fd45bb090 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.192267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5238ae9-9b69-4627-8b39-c16fd45bb090 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.192267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5238ae9-9b69-4627-8b39-c16fd45bb090 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.193609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 665/1335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:06.198905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8afe2-e91e-4eef-9a45-fc70cc1e6deb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.199324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8afe2-e91e-4eef-9a45-fc70cc1e6deb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.199434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8afe2-e91e-4eef-9a45-fc70cc1e6deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.263080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-05a8afe2-e91e-4eef-9a45-fc70cc1e6deb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:06.264259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-05a8afe2-e91e-4eef-9a45-fc70cc1e6deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:06.337391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.359934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 671/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:06.643476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5238ae9-9b69-4627-8b39-c16fd45bb090 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.644989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e5238ae9-9b69-4627-8b39-c16fd45bb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:06.745819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5238ae9-9b69-4627-8b39-c16fd45bb090 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.773600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.818452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.819056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.819328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.819594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.821146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:06.925662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:06.927067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f472a-085d-49ab-8f34-ce50bb89cdaf service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:06.945198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 666/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:09.133868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccaa77-b058-485b-a715-82a2233b3166 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.134412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccaa77-b058-485b-a715-82a2233b3166 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.134412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccaa77-b058-485b-a715-82a2233b3166 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.135764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 672/1338] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:09.141540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebd578-b1cd-434d-8d54-7dd9a30ca456 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.141935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebd578-b1cd-434d-8d54-7dd9a30ca456 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.142092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebd578-b1cd-434d-8d54-7dd9a30ca456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.207044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-dfebd578-b1cd-434d-8d54-7dd9a30ca456 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:09.208233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-dfebd578-b1cd-434d-8d54-7dd9a30ca456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:09.216333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.301797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 667/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:09.579708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccaa77-b058-485b-a715-82a2233b3166 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.581288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7dccaa77-b058-485b-a715-82a2233b3166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:09.683342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccaa77-b058-485b-a715-82a2233b3166 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.754532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.755127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.755404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.755697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.757239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:09.792120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.868838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:09.870209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89dcdb-0698-436a-aad7-c50a5b7dd5b7 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:09.888234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 673/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:13.684192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2915d-b0cd-47e4-b1b8-b5689283f591 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.684729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2915d-b0cd-47e4-b1b8-b5689283f591 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.684729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2915d-b0cd-47e4-b1b8-b5689283f591 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.686146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 668/1341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:13.693242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238b2f-100d-4c18-ab77-4ef1ab565a15 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.693696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238b2f-100d-4c18-ab77-4ef1ab565a15 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.693820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238b2f-100d-4c18-ab77-4ef1ab565a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.758814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-67238b2f-100d-4c18-ab77-4ef1ab565a15 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:13.760026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-67238b2f-100d-4c18-ab77-4ef1ab565a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:13.847094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.858552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 674/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:14.140371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2915d-b0cd-47e4-b1b8-b5689283f591 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:14.142026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-11a2915d-b0cd-47e4-b1b8-b5689283f591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:14.248099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2915d-b0cd-47e4-b1b8-b5689283f591 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:14.291579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:14.328516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:14.329122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:14.329511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:14.329786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:14.331359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:14.442258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:14.443686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac75fc-703e-41ab-85e9-cb44bff52a30 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:14.461946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 669/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:17.018399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae758-f312-4dcd-96ae-05e0df9a69cc None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:17.018946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae758-f312-4dcd-96ae-05e0df9a69cc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:17.019073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae758-f312-4dcd-96ae-05e0df9a69cc None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:17.020436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 675/1344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:17.026632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147036-077b-43f7-88b5-ba8e201d6ddf None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:17.027175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147036-077b-43f7-88b5-ba8e201d6ddf None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:17.027175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147036-077b-43f7-88b5-ba8e201d6ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:17.093784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-32147036-077b-43f7-88b5-ba8e201d6ddf None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:17.094991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-32147036-077b-43f7-88b5-ba8e201d6ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:17.112639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:17.190522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 670/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:17.472230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ae758-f312-4dcd-96ae-05e0df9a69cc None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:17.473854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-713ae758-f312-4dcd-96ae-05e0df9a69cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:17.575454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ae758-f312-4dcd-96ae-05e0df9a69cc None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:17.648845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:17.649417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:17.649700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:17.649972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:17.651665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:17.698009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:17.766432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:17.767930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10d64-5d30-4c67-88be-d8a69078824a service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:17.786380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 676/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:21.617637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc72a3-5e2e-4ff7-8e18-000d8b9cffff None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.618143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc72a3-5e2e-4ff7-8e18-000d8b9cffff None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.618253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc72a3-5e2e-4ff7-8e18-000d8b9cffff None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.619535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 671/1347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:21.625500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f8cf-b4eb-4b0b-9849-cfdb64595334 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.625967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f8cf-b4eb-4b0b-9849-cfdb64595334 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.626073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f8cf-b4eb-4b0b-9849-cfdb64595334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.704945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5548f8cf-b4eb-4b0b-9849-cfdb64595334 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:21.706290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5548f8cf-b4eb-4b0b-9849-cfdb64595334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:21.810228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.813920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 677/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:50:22.095080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc72a3-5e2e-4ff7-8e18-000d8b9cffff None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.096643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-37cc72a3-5e2e-4ff7-8e18-000d8b9cffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:22.218519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc72a3-5e2e-4ff7-8e18-000d8b9cffff None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.268157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:22.300401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.301024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.301347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.301628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.303280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:22.444604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:22.446015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3da2a-92ae-4420-a8f8-a6ddf7c9fa2c service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:22.464474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 672/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:50:27.289995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671c986-823c-4d3c-b5c0-2530433a0d24 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.291424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671c986-823c-4d3c-b5c0-2530433a0d24 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.291843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671c986-823c-4d3c-b5c0-2530433a0d24 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.294801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 678/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:50:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:27.300838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed51f-a535-4a70-ab8a-e3d2a2d8e32a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.301372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed51f-a535-4a70-ab8a-e3d2a2d8e32a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.301473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed51f-a535-4a70-ab8a-e3d2a2d8e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.436561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-56bed51f-a535-4a70-ab8a-e3d2a2d8e32a None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:27.437822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-56bed51f-a535-4a70-ab8a-e3d2a2d8e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:27.457134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:27.621445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 673/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:50:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:31.758877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109705a-1a88-45ae-987a-11d1f023d66a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.759723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109705a-1a88-45ae-987a-11d1f023d66a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.759998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109705a-1a88-45ae-987a-11d1f023d66a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.761640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 679/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:31.766673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b91f9-b0c8-44ad-b0db-26e0a8a5f3fd None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.767567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b91f9-b0c8-44ad-b0db-26e0a8a5f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.768035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b91f9-b0c8-44ad-b0db-26e0a8a5f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.847465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-125b91f9-b0c8-44ad-b0db-26e0a8a5f3fd None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:31.849011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-125b91f9-b0c8-44ad-b0db-26e0a8a5f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:31.923253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.962949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 674/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:50:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:33.387736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246b35-0177-47d2-bc0a-e42cf1ad7463 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:33.388325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246b35-0177-47d2-bc0a-e42cf1ad7463 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:33.388325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246b35-0177-47d2-bc0a-e42cf1ad7463 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:33.389660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 680/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:33.394877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e94ba7-0146-4e93-a9e9-3557a4a4bfcb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:33.395345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e94ba7-0146-4e93-a9e9-3557a4a4bfcb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:33.395589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e94ba7-0146-4e93-a9e9-3557a4a4bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:33.472786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-18e94ba7-0146-4e93-a9e9-3557a4a4bfcb None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:33.474018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-18e94ba7-0146-4e93-a9e9-3557a4a4bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:33.581679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 675/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:50:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:36.780722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07116d3e-bc06-4705-a047-837de0862719 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.781288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07116d3e-bc06-4705-a047-837de0862719 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.781403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07116d3e-bc06-4705-a047-837de0862719 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.782818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 681/1356] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:36.788032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb7f1-0556-4f3d-b659-78e1fcb9878e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.788445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb7f1-0556-4f3d-b659-78e1fcb9878e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.788576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eb7f1-0556-4f3d-b659-78e1fcb9878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.824976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.865444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-297eb7f1-0556-4f3d-b659-78e1fcb9878e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:36.867613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-297eb7f1-0556-4f3d-b659-78e1fcb9878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:36.981724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 676/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:37.293823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f6d6-8c57-44d7-9bdc-ddc7f03ec750 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.294405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f6d6-8c57-44d7-9bdc-ddc7f03ec750 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.294934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f6d6-8c57-44d7-9bdc-ddc7f03ec750 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.297633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 682/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 07:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:37.309745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba098-9902-45f3-8d75-2a828f579f87 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.311557 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba098-9902-45f3-8d75-2a828f579f87 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.312162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba098-9902-45f3-8d75-2a828f579f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.416278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5d6ba098-9902-45f3-8d75-2a828f579f87 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:37.417599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5d6ba098-9902-45f3-8d75-2a828f579f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:37.468305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:37.545513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 677/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 07:50:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:37.552002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011f6d6-8c57-44d7-9bdc-ddc7f03ec750 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:37.553580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0011f6d6-8c57-44d7-9bdc-ddc7f03ec750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:37.732535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011f6d6-8c57-44d7-9bdc-ddc7f03ec750 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:37.822279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:37.871673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:37.872294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.873901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.874186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.875925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:37.999163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:38.001070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ce9a-0295-4d6d-abc4-090c9ce9507d service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:38.020897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 683/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:40.165041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73ad4e-eeed-4fb7-984c-6337cbd5b8cc None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.165597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73ad4e-eeed-4fb7-984c-6337cbd5b8cc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.165721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73ad4e-eeed-4fb7-984c-6337cbd5b8cc None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.167157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 678/1361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:40.172567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881e59-3c7c-462c-85dc-2ce148a4e453 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.173034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881e59-3c7c-462c-85dc-2ce148a4e453 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.173418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881e59-3c7c-462c-85dc-2ce148a4e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.242421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3e881e59-3c7c-462c-85dc-2ce148a4e453 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:40.243809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3e881e59-3c7c-462c-85dc-2ce148a4e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:40.283756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.367995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 684/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:40.664524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73ad4e-eeed-4fb7-984c-6337cbd5b8cc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.666198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4d73ad4e-eeed-4fb7-984c-6337cbd5b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:40.816218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73ad4e-eeed-4fb7-984c-6337cbd5b8cc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.825516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.934149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.934769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.935056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.935329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.937132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:41.046179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.048855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b019d-4d30-48f3-bd77-5a18b16564c2 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.072501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 679/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:43.311455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021199c-457a-4652-a92b-a8efd23bb0eb None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.312014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021199c-457a-4652-a92b-a8efd23bb0eb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.312014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021199c-457a-4652-a92b-a8efd23bb0eb None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.313554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 685/1364] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:43.319265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a74a01-d5b8-475e-b75a-7f37caac5a6f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.320079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a74a01-d5b8-475e-b75a-7f37caac5a6f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.320434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a74a01-d5b8-475e-b75a-7f37caac5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.336770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.396249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-40a74a01-d5b8-475e-b75a-7f37caac5a6f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:43.397775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-40a74a01-d5b8-475e-b75a-7f37caac5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:43.498658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 680/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:43.789381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f366-4d79-41d8-8a8d-97920cd661f9 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.789863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f366-4d79-41d8-8a8d-97920cd661f9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.790385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f366-4d79-41d8-8a8d-97920cd661f9 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.792092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 686/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 07:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:43.798995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41588-d90b-4b6b-bb70-dde611cbb983 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.799289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41588-d90b-4b6b-bb70-dde611cbb983 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.799562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a41588-d90b-4b6b-bb70-dde611cbb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.879131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-79a41588-d90b-4b6b-bb70-dde611cbb983 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:43.880340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-79a41588-d90b-4b6b-bb70-dde611cbb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:43.918178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:44.040535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 681/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 07:50:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:44.049550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f366-4d79-41d8-8a8d-97920cd661f9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:44.051411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7007f366-4d79-41d8-8a8d-97920cd661f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:44.210275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f366-4d79-41d8-8a8d-97920cd661f9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.231716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:44.334045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.334709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.334991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.335194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.336859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:44.433832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.435964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9bb6-11c5-4272-9256-2a2b2428131a service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.455029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 687/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:44.983351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720156c-ac24-4540-a770-224cf227e2be None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.983920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720156c-ac24-4540-a770-224cf227e2be None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.983920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720156c-ac24-4540-a770-224cf227e2be None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.985225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 682/1369] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:44.990491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5e1eb-247c-4f82-987c-e0c6d9a046f6 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.990777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5e1eb-247c-4f82-987c-e0c6d9a046f6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.991048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5e1eb-247c-4f82-987c-e0c6d9a046f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.024801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:45.061612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-acf5e1eb-247c-4f82-987c-e0c6d9a046f6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:45.062823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-acf5e1eb-247c-4f82-987c-e0c6d9a046f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:45.163791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 688/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:45.748485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7891e2-28ca-475f-9a58-10ac7bc59fc4 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.748485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7891e2-28ca-475f-9a58-10ac7bc59fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.748485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7891e2-28ca-475f-9a58-10ac7bc59fc4 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.750345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 683/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 24 07:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:45.754391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331c2e-4dbc-4b02-8dfc-58d2bf9fc283 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.754874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331c2e-4dbc-4b02-8dfc-58d2bf9fc283 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.755041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331c2e-4dbc-4b02-8dfc-58d2bf9fc283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.832881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8c331c2e-4dbc-4b02-8dfc-58d2bf9fc283 None None] MFA Rules not processed for user `f7a7f863bc194cefaec8d5fb79c670fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:45.834104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8c331c2e-4dbc-4b02-8dfc-58d2bf9fc283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:45.883149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:45.916203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 689/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 24 07:50:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:45.923994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7891e2-28ca-475f-9a58-10ac7bc59fc4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:45.925766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3d7891e2-28ca-475f-9a58-10ac7bc59fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:46.037378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7891e2-28ca-475f-9a58-10ac7bc59fc4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.080163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.116870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.117585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.117865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.118141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.119834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:46.238476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.239922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010cb6c-ffe8-43cc-af49-43b88c679f51 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.271589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 684/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:46.440432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3d71a-5ac2-4307-a68a-92966f46cb5a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.440614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3d71a-5ac2-4307-a68a-92966f46cb5a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.440940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3d71a-5ac2-4307-a68a-92966f46cb5a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.442612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 690/1374] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:46.447488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b759f-66a5-4508-aa76-eb7fd4c097b7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.447981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b759f-66a5-4508-aa76-eb7fd4c097b7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.448140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b759f-66a5-4508-aa76-eb7fd4c097b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.523840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-293b759f-66a5-4508-aa76-eb7fd4c097b7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:46.525071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-293b759f-66a5-4508-aa76-eb7fd4c097b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:46.546215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.624054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 685/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:46.910581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3d71a-5ac2-4307-a68a-92966f46cb5a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.912112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-51f3d71a-5ac2-4307-a68a-92966f46cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:47.064071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3d71a-5ac2-4307-a68a-92966f46cb5a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.115073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.178836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.179439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.179716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.179985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.181594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:47.270376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.272261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46106232-797b-47de-bcd2-a95a8cbeb46b service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.290669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 691/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:49.227565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd831-4c56-4413-8c50-285c297caa15 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.228047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd831-4c56-4413-8c50-285c297caa15 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.228183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd831-4c56-4413-8c50-285c297caa15 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.229478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 686/1377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:49.235260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e446c-d77e-4536-8795-406851182554 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.236110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e446c-d77e-4536-8795-406851182554 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.236541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e446c-d77e-4536-8795-406851182554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.311970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-1e9e446c-d77e-4536-8795-406851182554 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:49.313209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1e9e446c-d77e-4536-8795-406851182554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:49.321587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.417668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 692/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:50:49.713480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd831-4c56-4413-8c50-285c297caa15 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.715258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-dafdd831-4c56-4413-8c50-285c297caa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:49.904102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd831-4c56-4413-8c50-285c297caa15 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.908247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.143907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.144602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.145018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.145327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.147353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:50.244721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.246416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238acb67-237c-46ba-8753-5bbe6b025e60 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.265641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 687/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:52.224144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff7d5-4332-4f1c-a41b-f3980a3d2dc9 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.224699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff7d5-4332-4f1c-a41b-f3980a3d2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.224699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff7d5-4332-4f1c-a41b-f3980a3d2dc9 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.226122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 693/1380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:52.231109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f6be-3acd-405e-b746-a20ff640db94 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.231527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f6be-3acd-405e-b746-a20ff640db94 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.231655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f6be-3acd-405e-b746-a20ff640db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.242977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.299886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ac37f6be-3acd-405e-b746-a20ff640db94 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:52.301069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ac37f6be-3acd-405e-b746-a20ff640db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:52.408463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 688/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:52.696457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facff7d5-4332-4f1c-a41b-f3980a3d2dc9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.698221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-facff7d5-4332-4f1c-a41b-f3980a3d2dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:52.847456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.859754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facff7d5-4332-4f1c-a41b-f3980a3d2dc9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.980736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.981741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.982933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.983340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.985905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:53.087715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.089339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287d42-4c27-4a29-9657-df1fd7206051 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.100750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.110577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 694/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:55.461166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffce97-9b9a-402d-9309-f2ec2d2ce450 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.461744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffce97-9b9a-402d-9309-f2ec2d2ce450 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.461744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffce97-9b9a-402d-9309-f2ec2d2ce450 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.463079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 689/1383] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:55.468534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3fdd1-1535-4a7c-8ad6-b9a7ceb096f9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.468964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3fdd1-1535-4a7c-8ad6-b9a7ceb096f9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.469120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3fdd1-1535-4a7c-8ad6-b9a7ceb096f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.534832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9cc3fdd1-1535-4a7c-8ad6-b9a7ceb096f9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:55.536080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9cc3fdd1-1535-4a7c-8ad6-b9a7ceb096f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:55.639482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 695/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:55.925175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffce97-9b9a-402d-9309-f2ec2d2ce450 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.927230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-abffce97-9b9a-402d-9309-f2ec2d2ce450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:56.020157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.085748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffce97-9b9a-402d-9309-f2ec2d2ce450 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.201451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.202057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.202335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.202594 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.204170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:56.255348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.298506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.300095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f876829-6183-41ca-b180-e786bef04d63 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.318473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 690/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:58.229385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ddd24-5a52-4782-84e6-c5a89a557395 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.229945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ddd24-5a52-4782-84e6-c5a89a557395 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.229945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ddd24-5a52-4782-84e6-c5a89a557395 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.231245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 696/1386] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:58.237243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71848-9680-484d-a813-2369e812ebf8 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.237679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71848-9680-484d-a813-2369e812ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.237810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71848-9680-484d-a813-2369e812ebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.302976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-70e71848-9680-484d-a813-2369e812ebf8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:58.304181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-70e71848-9680-484d-a813-2369e812ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:58.406156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 691/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:50:58.693705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ddd24-5a52-4782-84e6-c5a89a557395 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.695209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-147ddd24-5a52-4782-84e6-c5a89a557395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:58.776036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.861405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ddd24-5a52-4782-84e6-c5a89a557395 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.992153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.992795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.993075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.993372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.995010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:59.043451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.099877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.101538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3d1a-aa85-4fa5-9fa1-afd4804f7279 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.120036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 697/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:01.053101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b9d1-f9d0-4933-967a-908c0e813532 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.053763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b9d1-f9d0-4933-967a-908c0e813532 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.053763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b9d1-f9d0-4933-967a-908c0e813532 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.055017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 692/1389] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:01.060777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.061233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.061355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.127861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:01.129066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.187892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a7d5-f75d-4be7-94cb-8e93446de032 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.188175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a7d5-f75d-4be7-94cb-8e93446de032 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.188455 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a7d5-f75d-4be7-94cb-8e93446de032 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.189823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 693/1390] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:01.194913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187249-bd18-427e-83e0-c020ce63a276 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.195192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187249-bd18-427e-83e0-c020ce63a276 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.195464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187249-bd18-427e-83e0-c020ce63a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.225535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 698/1391] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:01.231467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.263692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d7187249-bd18-427e-83e0-c020ce63a276 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:01.264891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d7187249-bd18-427e-83e0-c020ce63a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.360431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 694/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:51:01.512378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.513722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.527622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.627752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fff7-9dee-41e5-a735-df8b7bae1675 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.658443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1628dba-c024-458d-9309-4eec026492c5 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.658731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1628dba-c024-458d-9309-4eec026492c5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.659009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1628dba-c024-458d-9309-4eec026492c5 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.660481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 695/1393] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 24 07:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:01.665009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.665320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.665597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.743380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.743989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.744239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] MFA Rules not processed for user `51791d40886b419fbaf269508382702e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:01.744345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.744530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.745494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.746147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.755332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.795607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.824386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 696/1394] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 24 07:51:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:51:01.832017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.839194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10ee99-36c6-4640-8a1a-6c6745eb47a7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.839722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.841861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a41ca-528f-4111-8227-9a19d0edadc6 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.860074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 699/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:01.914924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.915567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.915817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.916082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.917671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:02.037383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.038828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be2386-cbdd-47ed-969c-f2258db86262 service glance] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.054643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:02.060534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 697/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:51:02.782959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b7bb-1cd1-4f3e-a1cd-2ca1fcf326f2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.783400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b7bb-1cd1-4f3e-a1cd-2ca1fcf326f2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.783513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4b7bb-1cd1-4f3e-a1cd-2ca1fcf326f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.853069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a1b4b7bb-1cd1-4f3e-a1cd-2ca1fcf326f2 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:02.854240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a1b4b7bb-1cd1-4f3e-a1cd-2ca1fcf326f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:02.937182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:02.941410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 700/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 07:51:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:02.989568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559202-34e0-49f6-9eaa-ba1dc492aadf None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.989849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559202-34e0-49f6-9eaa-ba1dc492aadf None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.990119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559202-34e0-49f6-9eaa-ba1dc492aadf None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.991467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 698/1398] 10.222.0.18 () {54 vars in 943 bytes} [Wed Aug 24 07:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:02.998510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af551-db84-42ad-b6a0-4c98a94e2b73 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.998800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af551-db84-42ad-b6a0-4c98a94e2b73 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.999076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af551-db84-42ad-b6a0-4c98a94e2b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.073371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-572af551-db84-42ad-b6a0-4c98a94e2b73 None None] MFA Rules not processed for user `b2f9c8b7933e4742a5023154e9fd2218`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:03.074561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-572af551-db84-42ad-b6a0-4c98a94e2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:03.198828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 701/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Aug 24 07:51:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:03.208835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559202-34e0-49f6-9eaa-ba1dc492aadf None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:03.210527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-09559202-34e0-49f6-9eaa-ba1dc492aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:03.345795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559202-34e0-49f6-9eaa-ba1dc492aadf None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:03.431089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:03.457451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:03.458109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.458391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.458984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.460467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:03.545421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:03.547007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd37b7c-1eb6-4a16-ab27-a64ecc703ded service swift] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:03.554852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 699/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 07:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:51:03.802002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e71b2-cfa9-4f15-98fe-35016f91df40 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.802535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e71b2-cfa9-4f15-98fe-35016f91df40 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.802535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e71b2-cfa9-4f15-98fe-35016f91df40 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.803835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 702/1401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:03.809216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae91c6-9b48-44bf-a226-cebc7a224108 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.810141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae91c6-9b48-44bf-a226-cebc7a224108 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.810410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae91c6-9b48-44bf-a226-cebc7a224108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.880366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-49ae91c6-9b48-44bf-a226-cebc7a224108 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:03.881623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-49ae91c6-9b48-44bf-a226-cebc7a224108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:03.953228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:03.984707 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 700/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:51:04.416542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e71b2-cfa9-4f15-98fe-35016f91df40 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.418185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-171e71b2-cfa9-4f15-98fe-35016f91df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:04.490466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.592089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e71b2-cfa9-4f15-98fe-35016f91df40 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:04.722438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:04.723200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.723552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.723885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.725568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:04.749087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.833147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:04.834773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4296f-1cd2-4fe0-924a-09e34a07869a service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:04.855849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 703/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:06.820186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac9941-2b43-4f9b-9163-a2f6df3a523c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.820186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac9941-2b43-4f9b-9163-a2f6df3a523c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.820186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac9941-2b43-4f9b-9163-a2f6df3a523c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.824632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 701/1404] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:51:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:06.827571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e7c0-6f7e-4382-af76-e690ebb02161 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.829496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e7c0-6f7e-4382-af76-e690ebb02161 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.829496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e7c0-6f7e-4382-af76-e690ebb02161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.927318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-89b4e7c0-6f7e-4382-af76-e690ebb02161 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:06.928660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-89b4e7c0-6f7e-4382-af76-e690ebb02161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:07.032864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.039436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 704/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:51:07.333952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac9941-2b43-4f9b-9163-a2f6df3a523c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.335478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-92ac9941-2b43-4f9b-9163-a2f6df3a523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:07.510022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac9941-2b43-4f9b-9163-a2f6df3a523c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.577205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.642381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.643116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.643696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.644033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.645711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:07.743084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.744666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500d55d-0b52-4c3a-8fcd-7f3d03774bbb service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.762902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 702/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:09.718554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85734d-e35d-4807-bfa8-588c9e2d97f7 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.719146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85734d-e35d-4807-bfa8-588c9e2d97f7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.719146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85734d-e35d-4807-bfa8-588c9e2d97f7 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.720826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 705/1407] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:09.726070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0250-2739-474f-a64e-3a0efa9d6d70 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.726503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0250-2739-474f-a64e-3a0efa9d6d70 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.726599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0250-2739-474f-a64e-3a0efa9d6d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.797474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f8ff0250-2739-474f-a64e-3a0efa9d6d70 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:09.799032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f8ff0250-2739-474f-a64e-3a0efa9d6d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:09.813443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.905137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 703/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:10.191832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85734d-e35d-4807-bfa8-588c9e2d97f7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.193558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0b85734d-e35d-4807-bfa8-588c9e2d97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:10.365668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85734d-e35d-4807-bfa8-588c9e2d97f7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.443716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:10.499000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.499635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.499920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.500185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.501800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:10.600107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:10.601655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be786be6-3249-4124-a414-bb6bf8a49eae service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:10.624511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 706/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:19.903496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=38 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:20.622185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=64 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:25.327263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bead-2cbf-43ca-a252-3b1cc272df0b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.327860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bead-2cbf-43ca-a252-3b1cc272df0b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.327860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bead-2cbf-43ca-a252-3b1cc272df0b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.329167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 704/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 24 07:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:25.334356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88067-7fc9-4429-b9e7-1ef9ac32c03e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.334765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88067-7fc9-4429-b9e7-1ef9ac32c03e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.334906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88067-7fc9-4429-b9e7-1ef9ac32c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.409497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8ec88067-7fc9-4429-b9e7-1ef9ac32c03e None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:25.411047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8ec88067-7fc9-4429-b9e7-1ef9ac32c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:25.516169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 707/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 24 07:51:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:25.530486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ec025-1c61-4b0e-a886-537ba95fc13b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.530771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ec025-1c61-4b0e-a886-537ba95fc13b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.531047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ec025-1c61-4b0e-a886-537ba95fc13b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.532382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 705/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 24 07:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:25.536919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b053c49-282f-4a59-8327-5078f734933d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.537209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b053c49-282f-4a59-8327-5078f734933d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.537523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b053c49-282f-4a59-8327-5078f734933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.609315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:25.611948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2b053c49-282f-4a59-8327-5078f734933d None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:25.613782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2b053c49-282f-4a59-8327-5078f734933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:25.728321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 708/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 24 07:51:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:51:28.073007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016542-c0ff-40dc-9d94-58a9b2e324a9 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.073492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016542-c0ff-40dc-9d94-58a9b2e324a9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.073602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016542-c0ff-40dc-9d94-58a9b2e324a9 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.074941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:28.080285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc8a04-47e2-4ba3-9563-c3c26e764e1b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.080688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc8a04-47e2-4ba3-9563-c3c26e764e1b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.080844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc8a04-47e2-4ba3-9563-c3c26e764e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.146212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-73bc8a04-47e2-4ba3-9563-c3c26e764e1b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:28.147701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-73bc8a04-47e2-4ba3-9563-c3c26e764e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:28.202828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.244975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:28.533941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5016542-c0ff-40dc-9d94-58a9b2e324a9 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.535464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e5016542-c0ff-40dc-9d94-58a9b2e324a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:28.680465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5016542-c0ff-40dc-9d94-58a9b2e324a9 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.753389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.797018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.798864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.799193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.799558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.801378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:28.890366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.891940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e6105-1b70-4494-8587-c95a2eed1b22 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.909552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 707/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:29.801007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89381e-be88-477c-b949-4eeb792c5e92 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.801616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89381e-be88-477c-b949-4eeb792c5e92 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.801721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89381e-be88-477c-b949-4eeb792c5e92 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.803134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:29.808153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bddea-079d-4b75-a356-a3ece0508b2b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.808605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bddea-079d-4b75-a356-a3ece0508b2b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.808721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bddea-079d-4b75-a356-a3ece0508b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.882241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c34bddea-079d-4b75-a356-a3ece0508b2b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:29.883455 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c34bddea-079d-4b75-a356-a3ece0508b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:29.910326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:29.979989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:30.129674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89381e-be88-477c-b949-4eeb792c5e92 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:30.131222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0f89381e-be88-477c-b949-4eeb792c5e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:30.275387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89381e-be88-477c-b949-4eeb792c5e92 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:30.315509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:30.389012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:30.389642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:30.389922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:30.390193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:30.391760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:30.479076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:30.480663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0653e-4bda-4d0c-89bf-ee1484de76d4 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:30.498902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 711/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:31.386115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50df77-04cd-4b14-b2f3-d3805ffbeae8 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.386583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50df77-04cd-4b14-b2f3-d3805ffbeae8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.386706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50df77-04cd-4b14-b2f3-d3805ffbeae8 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.388601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:31.393415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b943dfd-c49e-4473-ab8d-ec819a04b7c6 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.393824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b943dfd-c49e-4473-ab8d-ec819a04b7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.393968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b943dfd-c49e-4473-ab8d-ec819a04b7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.449018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.471862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5b943dfd-c49e-4473-ab8d-ec819a04b7c6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:31.473066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5b943dfd-c49e-4473-ab8d-ec819a04b7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:31.566096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:31.719028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50df77-04cd-4b14-b2f3-d3805ffbeae8 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:31.720696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-af50df77-04cd-4b14-b2f3-d3805ffbeae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:31.861690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50df77-04cd-4b14-b2f3-d3805ffbeae8 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:31.873333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.973191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:31.973738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.974011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.974273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.975823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:32.061599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.063166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531443e-4254-42d0-bd14-4bfc22aa716e service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.080741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 710/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:32.935641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5490-5c29-46b4-933a-5f6dbb2b87e0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.937201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5490-5c29-46b4-933a-5f6dbb2b87e0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.937201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e5490-5c29-46b4-933a-5f6dbb2b87e0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.937597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:32.942365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89a8ae-a5e9-4cad-9e22-487a30b5b43b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.942810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89a8ae-a5e9-4cad-9e22-487a30b5b43b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.942919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89a8ae-a5e9-4cad-9e22-487a30b5b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.962563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.017871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-dc89a8ae-a5e9-4cad-9e22-487a30b5b43b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:33.019071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-dc89a8ae-a5e9-4cad-9e22-487a30b5b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:33.112726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:33.264791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5490-5c29-46b4-933a-5f6dbb2b87e0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.266242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b02e5490-5c29-46b4-933a-5f6dbb2b87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:33.375520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.411232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e5490-5c29-46b4-933a-5f6dbb2b87e0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.521242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.522033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.522326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.522601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.524194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:33.598874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.612906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.614536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16920680-599b-49fe-b9be-99e7f61a55eb service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.632821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 714/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:34.488893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dffa0-02d6-427f-85c5-bb44cb969730 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:34.489472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dffa0-02d6-427f-85c5-bb44cb969730 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:34.489472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dffa0-02d6-427f-85c5-bb44cb969730 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:34.490826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:34.495627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d010-48d3-4314-a8fc-1eb42961feec None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:34.496081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d010-48d3-4314-a8fc-1eb42961feec None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:34.496189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d010-48d3-4314-a8fc-1eb42961feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:34.570565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d732d010-48d3-4314-a8fc-1eb42961feec None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:34.571760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d732d010-48d3-4314-a8fc-1eb42961feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:34.664692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:34.816154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dffa0-02d6-427f-85c5-bb44cb969730 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:34.817709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-127dffa0-02d6-427f-85c5-bb44cb969730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:34.898942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:34.960329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dffa0-02d6-427f-85c5-bb44cb969730 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:35.070462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:35.071058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.071331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.071595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.073160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:35.120070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:35.161820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:35.163391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13932-5b54-44f8-90f3-27c62b8d36fd service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:35.181216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 713/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:35.976818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65433663-aa00-484b-bd93-bc969f76db32 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.977418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65433663-aa00-484b-bd93-bc969f76db32 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.977418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65433663-aa00-484b-bd93-bc969f76db32 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.978752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:35.984544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809e75-f331-4631-86f3-2b6eaba2ce65 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.984919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809e75-f331-4631-86f3-2b6eaba2ce65 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.985122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809e75-f331-4631-86f3-2b6eaba2ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.059242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f0809e75-f331-4631-86f3-2b6eaba2ce65 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:36.061022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f0809e75-f331-4631-86f3-2b6eaba2ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:36.154915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:36.305014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65433663-aa00-484b-bd93-bc969f76db32 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:36.306570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-65433663-aa00-484b-bd93-bc969f76db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:36.358119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:36.454388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65433663-aa00-484b-bd93-bc969f76db32 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:36.564989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:36.565545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.565827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.566101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.567682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:36.574533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:36.658181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:36.659800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859ab5-482c-4174-9400-6c62446d403e service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:36.677711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 717/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:37.475703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03c9e4-9f6f-4b6f-8ade-51be08da256c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:37.476254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03c9e4-9f6f-4b6f-8ade-51be08da256c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:37.476254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03c9e4-9f6f-4b6f-8ade-51be08da256c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:37.477667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:37.482508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6c34-ebce-4bd7-ac1e-7882dde37f4c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:37.482921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6c34-ebce-4bd7-ac1e-7882dde37f4c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:37.483050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6c34-ebce-4bd7-ac1e-7882dde37f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:37.558730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f87d6c34-ebce-4bd7-ac1e-7882dde37f4c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:37.559992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f87d6c34-ebce-4bd7-ac1e-7882dde37f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:37.626829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:37.656287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:37.809153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03c9e4-9f6f-4b6f-8ade-51be08da256c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:37.811238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0a03c9e4-9f6f-4b6f-8ade-51be08da256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:37.828971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:37.955434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03c9e4-9f6f-4b6f-8ade-51be08da256c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:38.041083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:38.068250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:38.068848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.069128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.069418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.070981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:38.161233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:38.162957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de19d-52be-4a67-809d-2841bf6f07cb service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:38.185278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 716/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:38.985506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80902a-6464-420d-931a-fee67fb83913 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.986069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80902a-6464-420d-931a-fee67fb83913 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.986069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80902a-6464-420d-931a-fee67fb83913 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.987434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:38.992264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f030-fe9f-4a8b-aaf0-7c6db24fc78f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.992658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f030-fe9f-4a8b-aaf0-7c6db24fc78f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.992818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7f030-fe9f-4a8b-aaf0-7c6db24fc78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:39.068883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-76e7f030-fe9f-4a8b-aaf0-7c6db24fc78f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:39.070113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-76e7f030-fe9f-4a8b-aaf0-7c6db24fc78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:39.111861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:39.166739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:39.315263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80902a-6464-420d-931a-fee67fb83913 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:39.316707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0e80902a-6464-420d-931a-fee67fb83913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:39.461544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80902a-6464-420d-931a-fee67fb83913 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:39.514792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:39.573783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:39.574317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:39.574595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:39.574864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:39.576450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:39.665034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:39.666674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cda0a-8b14-4168-acc0-5c6c9e6b05c7 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:39.685580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 720/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:40.480925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53cea-4edd-4506-86e6-ac89a56e3622 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.481502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53cea-4edd-4506-86e6-ac89a56e3622 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.481611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53cea-4edd-4506-86e6-ac89a56e3622 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.482924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:40.487818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5812-6138-43ef-832e-ac7da0c43ab8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.488241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5812-6138-43ef-832e-ac7da0c43ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.488369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5812-6138-43ef-832e-ac7da0c43ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.563168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5e5b5812-6138-43ef-832e-ac7da0c43ab8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:40.564415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5e5b5812-6138-43ef-832e-ac7da0c43ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:40.566442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:40.661298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:40.808229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53cea-4edd-4506-86e6-ac89a56e3622 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:40.810298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4bb53cea-4edd-4506-86e6-ac89a56e3622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:40.951979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53cea-4edd-4506-86e6-ac89a56e3622 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:40.978885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.064401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.065005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.065298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.065569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.067134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:41.153674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.155300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace95dd-a954-486b-8dfb-f5f35db7d114 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.173385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 719/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:51:43.007693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac447-b076-4fd8-a656-c37397fb17b6 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:43.008259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac447-b076-4fd8-a656-c37397fb17b6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:43.008259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac447-b076-4fd8-a656-c37397fb17b6 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:43.009623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:43.015764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fef4-886a-48df-8c65-1fa067ae27b6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:43.016146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fef4-886a-48df-8c65-1fa067ae27b6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:43.016335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fef4-886a-48df-8c65-1fa067ae27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:43.056308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:43.081889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2d88fef4-886a-48df-8c65-1fa067ae27b6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:43.083114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2d88fef4-886a-48df-8c65-1fa067ae27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:43.187108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:43.476583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac447-b076-4fd8-a656-c37397fb17b6 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:43.478187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e3fac447-b076-4fd8-a656-c37397fb17b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:43.580312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac447-b076-4fd8-a656-c37397fb17b6 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:43.612083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:43.652728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:43.653902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:43.654184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:43.654456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:43.656048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:43.762764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:43.764176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18e49f-728a-4a0f-bb07-ad72727e3776 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:43.784649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 723/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:45.808345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7fc0b-0a32-44c6-8828-79e67826b57a None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.808887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7fc0b-0a32-44c6-8828-79e67826b57a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.808887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7fc0b-0a32-44c6-8828-79e67826b57a None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.810273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:45.815397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67ab6-f63c-4b45-bb42-824001494267 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.815845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67ab6-f63c-4b45-bb42-824001494267 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.815953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67ab6-f63c-4b45-bb42-824001494267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.880830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-64b67ab6-f63c-4b45-bb42-824001494267 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:45.882052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-64b67ab6-f63c-4b45-bb42-824001494267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:45.895017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.977757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:46.261515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7fc0b-0a32-44c6-8828-79e67826b57a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.263649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-56c7fc0b-0a32-44c6-8828-79e67826b57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:46.365478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7fc0b-0a32-44c6-8828-79e67826b57a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.378295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:46.442539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.443144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.443422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.443698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.445306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:46.552705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.554074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825acb14-3258-48ab-9cf4-4486d44eea1e service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.572020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 722/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:48.765708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469df3-26aa-4748-a172-fb0042a8e004 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.766302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469df3-26aa-4748-a172-fb0042a8e004 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.766302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469df3-26aa-4748-a172-fb0042a8e004 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.767594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:48.773215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3be2f-e47b-4d4a-b181-a13fdb3f1e05 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.773628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3be2f-e47b-4d4a-b181-a13fdb3f1e05 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.773851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3be2f-e47b-4d4a-b181-a13fdb3f1e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.820989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:48.838682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-32e3be2f-e47b-4d4a-b181-a13fdb3f1e05 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:48.839869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-32e3be2f-e47b-4d4a-b181-a13fdb3f1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:48.933523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:49.214160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46469df3-26aa-4748-a172-fb0042a8e004 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:49.215737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-46469df3-26aa-4748-a172-fb0042a8e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:49.320641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46469df3-26aa-4748-a172-fb0042a8e004 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:49.360570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.395461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:49.396068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:49.396345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:49.396611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:49.398481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:49.506242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:49.507668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd9ba3-5501-4646-8e4f-0bc94b8383a2 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:49.525615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 726/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:51.551733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f09a-a0ce-402b-8e7e-1d324c0bef29 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.552285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f09a-a0ce-402b-8e7e-1d324c0bef29 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.552285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f09a-a0ce-402b-8e7e-1d324c0bef29 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.553687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:51.559083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cda78-b19e-4f50-beef-315074c656d9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.559513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cda78-b19e-4f50-beef-315074c656d9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.559656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cda78-b19e-4f50-beef-315074c656d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.625852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a35cda78-b19e-4f50-beef-315074c656d9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:51.626981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a35cda78-b19e-4f50-beef-315074c656d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:51.647869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:51.722773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:52.007800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f09a-a0ce-402b-8e7e-1d324c0bef29 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:52.009393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f394f09a-a0ce-402b-8e7e-1d324c0bef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:52.109943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f09a-a0ce-402b-8e7e-1d324c0bef29 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:52.128893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:52.182041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:52.182640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:52.182919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:52.183189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:52.184772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:52.291066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:52.292453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2388d-fa5d-4116-8a62-264ec808952b service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:52.311654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 725/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:54.263526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da77ca-bc17-47dd-8ada-23ccb787d2c5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.264059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da77ca-bc17-47dd-8ada-23ccb787d2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.264059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da77ca-bc17-47dd-8ada-23ccb787d2c5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.265360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:54.270591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd719bd-1101-4c6a-8fc5-36037debc7d5 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.271011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd719bd-1101-4c6a-8fc5-36037debc7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.271140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd719bd-1101-4c6a-8fc5-36037debc7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.333754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:54.336683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4fd719bd-1101-4c6a-8fc5-36037debc7d5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:54.338441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4fd719bd-1101-4c6a-8fc5-36037debc7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:54.433907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:54.715120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da77ca-bc17-47dd-8ada-23ccb787d2c5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:54.716696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-96da77ca-bc17-47dd-8ada-23ccb787d2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:54.820069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da77ca-bc17-47dd-8ada-23ccb787d2c5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:54.867938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:54.892800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:54.893429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.893713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.893986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.895573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:55.003268 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:55.004615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326711d-d739-4e54-9469-1e76ea53bafd service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:55.022479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 729/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:57.055752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d190d7-9f63-4d41-8837-b4bc92c626d4 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:57.056329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d190d7-9f63-4d41-8837-b4bc92c626d4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:57.056329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d190d7-9f63-4d41-8837-b4bc92c626d4 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:57.057658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:57.062923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472067e0-a9ee-4bbb-9f2e-99ce3680f766 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:57.063354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472067e0-a9ee-4bbb-9f2e-99ce3680f766 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:57.063463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472067e0-a9ee-4bbb-9f2e-99ce3680f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:57.129151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-472067e0-a9ee-4bbb-9f2e-99ce3680f766 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:57.130366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-472067e0-a9ee-4bbb-9f2e-99ce3680f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:57.159605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:57.227543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:51:57.516177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d190d7-9f63-4d41-8837-b4bc92c626d4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:57.517756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-93d190d7-9f63-4d41-8837-b4bc92c626d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:57.619042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d190d7-9f63-4d41-8837-b4bc92c626d4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:57.646652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:57.691307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:57.691911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:57.692191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:57.692465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:57.694110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:57.800776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:57.802260 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26779-c620-49b1-8ff6-6ba9b1c27473 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:57.822024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 728/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:51:59.742455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01059d-2423-4ddc-a78c-be0ff1c0bc7b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:59.742993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01059d-2423-4ddc-a78c-be0ff1c0bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:59.742993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01059d-2423-4ddc-a78c-be0ff1c0bc7b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:59.744380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:59.750273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabd858-75d2-456d-9514-85a2c7c32df3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:59.750689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabd858-75d2-456d-9514-85a2c7c32df3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:59.750857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabd858-75d2-456d-9514-85a2c7c32df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:59.816695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8dabd858-75d2-456d-9514-85a2c7c32df3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:59.817911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8dabd858-75d2-456d-9514-85a2c7c32df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:59.826067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:59.913330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:00.198620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01059d-2423-4ddc-a78c-be0ff1c0bc7b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:00.200210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4d01059d-2423-4ddc-a78c-be0ff1c0bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:00.301123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01059d-2423-4ddc-a78c-be0ff1c0bc7b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:00.355171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:00.374284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:00.374883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:00.375157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:00.375421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:00.376979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:00.483652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:00.485070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af275149-aec7-45a0-a443-ee4e54073c3f service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:00.503202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 732/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:02.424351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dbe0f-5d31-4054-addf-34adc07c6e43 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:02.424914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dbe0f-5d31-4054-addf-34adc07c6e43 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:02.424914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dbe0f-5d31-4054-addf-34adc07c6e43 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:02.426338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:02.431723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228da33f-30dc-44e5-a52c-32aebe36c8a2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:02.432126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228da33f-30dc-44e5-a52c-32aebe36c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:02.432276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228da33f-30dc-44e5-a52c-32aebe36c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:02.497862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-228da33f-30dc-44e5-a52c-32aebe36c8a2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:02.499060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-228da33f-30dc-44e5-a52c-32aebe36c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:02.536807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:02.595281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:52:02.875116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dbe0f-5d31-4054-addf-34adc07c6e43 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:02.876671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4c1dbe0f-5d31-4054-addf-34adc07c6e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:02.976482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dbe0f-5d31-4054-addf-34adc07c6e43 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:03.014537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:03.049819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:03.050428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:03.050706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:03.050976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:03.052549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:03.158433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:03.159774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5de5d-7482-4e6d-aea8-6a3f240c2641 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:03.179547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 731/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:05.080387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fbfe2-bfb1-416d-b8fe-d27a6de5a29f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:05.080956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fbfe2-bfb1-416d-b8fe-d27a6de5a29f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:05.080956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fbfe2-bfb1-416d-b8fe-d27a6de5a29f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:05.082331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:05.087575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81c49-5cd6-425e-9526-18316134b59a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:05.087994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81c49-5cd6-425e-9526-18316134b59a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:05.088149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81c49-5cd6-425e-9526-18316134b59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:05.154692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-efd81c49-5cd6-425e-9526-18316134b59a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:05.155896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-efd81c49-5cd6-425e-9526-18316134b59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:05.174069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:05.253075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:05.540947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fbfe2-bfb1-416d-b8fe-d27a6de5a29f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:05.542524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4b2fbfe2-bfb1-416d-b8fe-d27a6de5a29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:05.646148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fbfe2-bfb1-416d-b8fe-d27a6de5a29f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:05.711552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:05.719185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:05.719777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:05.720053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:05.720320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:05.721916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:05.828675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:05.830117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da604-3451-4cc3-bf00-f945b49c0292 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:05.848119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 735/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:07.753853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df582d6-dc13-4f24-ac5f-1ebd37b2e6c7 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:07.754430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df582d6-dc13-4f24-ac5f-1ebd37b2e6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:07.754430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df582d6-dc13-4f24-ac5f-1ebd37b2e6c7 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:07.755729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:07.761199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe1bf-8a06-4c09-89c0-b6b3fcf28ec0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:07.761651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe1bf-8a06-4c09-89c0-b6b3fcf28ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:07.761759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe1bf-8a06-4c09-89c0-b6b3fcf28ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:07.828079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-896fe1bf-8a06-4c09-89c0-b6b3fcf28ec0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:07.829301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-896fe1bf-8a06-4c09-89c0-b6b3fcf28ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:07.876135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:07.924125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:08.200968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df582d6-dc13-4f24-ac5f-1ebd37b2e6c7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:08.202603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8df582d6-dc13-4f24-ac5f-1ebd37b2e6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:08.303806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df582d6-dc13-4f24-ac5f-1ebd37b2e6c7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:08.351820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:08.377971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:08.378577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:08.378861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:08.379135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:08.380722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:08.490021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:08.491379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224fab-0c53-4e3b-a7cc-9d865c8e2376 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:08.509772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 734/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:17.922334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=22 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:18.507503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=66 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:27.832228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c5e9-132b-4d86-9136-9f57e855e3c8 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:27.832795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c5e9-132b-4d86-9136-9f57e855e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:27.832795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c5e9-132b-4d86-9136-9f57e855e3c8 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:27.834176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 737/1471] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:27.839306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767eaf5-345d-4e28-84ab-f7155bfc839c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:27.839724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767eaf5-345d-4e28-84ab-f7155bfc839c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:27.840438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767eaf5-345d-4e28-84ab-f7155bfc839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:27.906482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6767eaf5-345d-4e28-84ab-f7155bfc839c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:27.907686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6767eaf5-345d-4e28-84ab-f7155bfc839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:28.001692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 735/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:28.295804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e94c-9cca-41da-add8-c3a69ef8722f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:28.296091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e94c-9cca-41da-add8-c3a69ef8722f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:28.296370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e94c-9cca-41da-add8-c3a69ef8722f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:28.297743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 738/1473] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 24 07:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:28.302643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4214-1d55-4f88-b49b-9186d2c9840b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:28.302928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4214-1d55-4f88-b49b-9186d2c9840b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:28.303197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4214-1d55-4f88-b49b-9186d2c9840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:28.378142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8fda4214-1d55-4f88-b49b-9186d2c9840b None None] MFA Rules not processed for user `51791d40886b419fbaf269508382702e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:28.379330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8fda4214-1d55-4f88-b49b-9186d2c9840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:28.399888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:28.455288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 736/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 24 07:52:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:28.462785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e94c-9cca-41da-add8-c3a69ef8722f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:28.464333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1b78e94c-9cca-41da-add8-c3a69ef8722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:28.567127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e94c-9cca-41da-add8-c3a69ef8722f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:28.637808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:28.638410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:28.638688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:28.638963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:28.640546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:28.694606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:28.748655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:28.750113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407bf9d-8bac-4ad5-a288-cff4ac2fa82f service glance] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:28.768945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 739/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:30.754322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c968b-58d8-446f-a4bf-786f68253ba9 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:30.754862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c968b-58d8-446f-a4bf-786f68253ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:30.754862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c968b-58d8-446f-a4bf-786f68253ba9 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:30.756252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 737/1476] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:30.761576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3db1-6d2b-4eed-a52d-5a837d4d6872 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:30.762029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3db1-6d2b-4eed-a52d-5a837d4d6872 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:30.762161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3db1-6d2b-4eed-a52d-5a837d4d6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:30.829653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f94c3db1-6d2b-4eed-a52d-5a837d4d6872 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:30.830887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f94c3db1-6d2b-4eed-a52d-5a837d4d6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:30.926514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 740/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:31.198092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c968b-58d8-446f-a4bf-786f68253ba9 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:31.199652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-709c968b-58d8-446f-a4bf-786f68253ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:31.323014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c968b-58d8-446f-a4bf-786f68253ba9 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:31.372701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:31.417602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:31.418220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:31.418506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:31.418783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:31.419411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:31.421117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:52:31.421117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:52:31.421117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:52:31.422285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33634067-d22d-472f-8538-37924a6c1265 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:31.441733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 738/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 07:52:31 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:52:33.351190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86da12-2d7b-46c7-ab7e-82bc8bc7f356 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:33.351704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86da12-2d7b-46c7-ab7e-82bc8bc7f356 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:33.351815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86da12-2d7b-46c7-ab7e-82bc8bc7f356 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:33.353076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 741/1479] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:33.358894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda40f-ade4-4d8b-b130-aed9172345a3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:33.359346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda40f-ade4-4d8b-b130-aed9172345a3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:33.359455 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda40f-ade4-4d8b-b130-aed9172345a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:33.424196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-30bda40f-ade4-4d8b-b130-aed9172345a3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:33.425413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-30bda40f-ade4-4d8b-b130-aed9172345a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:33.519286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 739/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:33.815842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86da12-2d7b-46c7-ab7e-82bc8bc7f356 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:33.817456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8d86da12-2d7b-46c7-ab7e-82bc8bc7f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:33.827184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:33.961028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86da12-2d7b-46c7-ab7e-82bc8bc7f356 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:34.041372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:34.076307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:34.076847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:34.077126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:34.077430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:34.079014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:34.166587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:34.168166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298235d-e597-4126-98d8-9d2e2e784a71 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:34.186436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 742/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:36.256340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeedbcc-5478-484c-be3f-28dc05456282 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:36.256871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeedbcc-5478-484c-be3f-28dc05456282 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:36.256983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeedbcc-5478-484c-be3f-28dc05456282 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:36.258418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 740/1482] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:36.264099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae8c52-4d8b-4047-bcc4-372ad1c4874d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:36.264535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae8c52-4d8b-4047-bcc4-372ad1c4874d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:36.264633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae8c52-4d8b-4047-bcc4-372ad1c4874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:36.329440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-aeae8c52-4d8b-4047-bcc4-372ad1c4874d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:36.330633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aeae8c52-4d8b-4047-bcc4-372ad1c4874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:36.377077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:36.428286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 743/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:36.715262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeedbcc-5478-484c-be3f-28dc05456282 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:36.716850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-aeeedbcc-5478-484c-be3f-28dc05456282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:36.740508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:36.822822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeedbcc-5478-484c-be3f-28dc05456282 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:36.895476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:36.896081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:36.896363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:36.896639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:36.898610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:36.970893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:37.005826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:37.007262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b04925-0ffb-441e-8c10-846e0ab623b7 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:37.025585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 741/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:38.964531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2d307-6f7d-4442-8ac2-9131d50bc701 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.965126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2d307-6f7d-4442-8ac2-9131d50bc701 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.965798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2d307-6f7d-4442-8ac2-9131d50bc701 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.967144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 744/1485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:38.972355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a27ad-9a5b-4a14-8931-724cf407b66d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.972784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a27ad-9a5b-4a14-8931-724cf407b66d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.972893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a27ad-9a5b-4a14-8931-724cf407b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:39.041184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-617a27ad-9a5b-4a14-8931-724cf407b66d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:39.042460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-617a27ad-9a5b-4a14-8931-724cf407b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:39.138811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 742/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:52:39.426279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2d307-6f7d-4442-8ac2-9131d50bc701 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:39.427819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5cd2d307-6f7d-4442-8ac2-9131d50bc701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:39.531509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2d307-6f7d-4442-8ac2-9131d50bc701 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:39.602141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:39.604246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:39.605110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:39.606139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:39.606431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:39.608392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:39.734118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:39.735539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fd062-aa7f-4932-8327-622b88da9537 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:39.869681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 745/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:41.855050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a6951-8622-4831-a64f-48a2eae6e0b1 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.855632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a6951-8622-4831-a64f-48a2eae6e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.855632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a6951-8622-4831-a64f-48a2eae6e0b1 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.856971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 743/1488] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:41.862212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5470ab-738b-4c53-be60-0d0796ba47bd None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.862642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5470ab-738b-4c53-be60-0d0796ba47bd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.862757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5470ab-738b-4c53-be60-0d0796ba47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.928184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6c5470ab-738b-4c53-be60-0d0796ba47bd None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:41.929444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6c5470ab-738b-4c53-be60-0d0796ba47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:41.981109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:42.024568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 746/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:42.314692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a6951-8622-4831-a64f-48a2eae6e0b1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:42.316223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1c9a6951-8622-4831-a64f-48a2eae6e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:42.353226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:42.425456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a6951-8622-4831-a64f-48a2eae6e0b1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:42.499674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:42.500275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:42.500548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:42.500811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:42.502456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:42.581034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:42.610727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:42.612153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2b1a8-b499-4e69-bb1c-88ecbf689dee service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:42.630484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 744/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:44.690513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d78a0b-f1a0-42b2-86be-f740752bd0af None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:44.691049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d78a0b-f1a0-42b2-86be-f740752bd0af None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:44.691049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d78a0b-f1a0-42b2-86be-f740752bd0af None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:44.692407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 747/1491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 07:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:44.697786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd40fd-bfff-4a04-9e7b-5099515da9d8 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:44.698194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd40fd-bfff-4a04-9e7b-5099515da9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:44.698358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd40fd-bfff-4a04-9e7b-5099515da9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:44.763990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-34cd40fd-bfff-4a04-9e7b-5099515da9d8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:44.765183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-34cd40fd-bfff-4a04-9e7b-5099515da9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:44.859757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 745/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:45.145828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d78a0b-f1a0-42b2-86be-f740752bd0af None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:45.147360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-89d78a0b-f1a0-42b2-86be-f740752bd0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:45.248720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d78a0b-f1a0-42b2-86be-f740752bd0af None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:45.319864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:45.320457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:45.320731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:45.320998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:45.322583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:45.331425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:45.431845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:45.433299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951a87-5d73-4b82-8029-89ddabbe67d2 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:45.452124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 748/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:54.858004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=82 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:55.449830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=50 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.397271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.397796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.397903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.472176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:56.473394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:56.566744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 746/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:53:56.574768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.575257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.575367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.655579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:56.656736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:56.758084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 749/1495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:53:56.763203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:56.764397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:56.776347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0795a-0891-4751-9b41-978b22aaeac4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.836579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.870014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.870620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.870895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.871163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.871786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:56.872084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:56.873089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:56.873089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:53:56.873089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:53:56.874004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:56.884843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 747/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:56.893816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:56.903739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08142-ff5b-42ff-80e8-e4c58e7895e1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.964048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.996918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.997547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.997820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.998083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.998699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:57.000384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:57.000384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:53:57.000384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:53:57.001662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:57.055417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 750/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:53:56 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:53:57.059758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:57.061283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:57.094818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9981ab1-3bc6-4421-9644-0e48398cf48b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:57.186971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:57.187570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.187842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.188107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.188717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:57.189739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:57.189739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:53:57.189739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:53:57.190932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:57.231730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 748/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:53:57 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:53:57.235727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:57.237316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:57.298164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feacc4-b3b7-482b-a2b0-ce68509525c3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:57.382142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:57.394061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:57.394662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.394936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.395205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.395833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:57.396855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:57.396855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:53:57.396855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:53:57.397766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:57.410163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 751/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:53:57.414176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:57.415732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:57.427066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1a98e-1dbf-4612-919e-5973746a1376 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:57.453470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:57.525954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:57.526478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.526753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.527021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.527651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:57.528648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:57.528648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:53:57.528648 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:53:57.529592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a6dd0-190c-4301-b13f-3a9e5ab2f751 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:57.542228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 749/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:53:57.546402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:57.547909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:57.580515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb92fe-a346-4909-ad85-141d14d4e36d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:57.671663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:57.672316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.672592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.672860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] PATH_INFO: `/v3/projects/f7900552137347e595e736ece973bce0/users/febd3d46462f48a9b7f1c1370bf56c75/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.694489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7900552137347e595e736ece973bce0, user_id=febd3d46462f48a9b7f1c1370bf56c75, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:57.695502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:57.695502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:53:57.695502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:53:57.697447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e8ad0-7268-42ef-99ce-09b8a0ebccf5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:57.720813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 752/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:53:57 2022] PUT /identity/v3/projects/f7900552137347e595e736ece973bce0/users/febd3d46462f48a9b7f1c1370bf56c75/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:53:57.733456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da471c-0bcd-4eae-b2cc-1419bab9fe56 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.733745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da471c-0bcd-4eae-b2cc-1419bab9fe56 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.734015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da471c-0bcd-4eae-b2cc-1419bab9fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.789490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a5da471c-0bcd-4eae-b2cc-1419bab9fe56 None None] MFA Rules not processed for user `febd3d46462f48a9b7f1c1370bf56c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:57.790609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a5da471c-0bcd-4eae-b2cc-1419bab9fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:57.865444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 750/1502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:53:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:53:57.878853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1707ea-d640-4ced-821c-c5dba0d21f0b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.879142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1707ea-d640-4ced-821c-c5dba0d21f0b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.879419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1707ea-d640-4ced-821c-c5dba0d21f0b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.880745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 753/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 24 07:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:57.885629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21e95-5525-410f-8a95-7bc04627d3c6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:57.885922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21e95-5525-410f-8a95-7bc04627d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:57.886200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21e95-5525-410f-8a95-7bc04627d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:57.918537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:57.962271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e1b21e95-5525-410f-8a95-7bc04627d3c6 None None] MFA Rules not processed for user `f7a7f863bc194cefaec8d5fb79c670fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:57.963991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e1b21e95-5525-410f-8a95-7bc04627d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.041106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 751/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 24 07:53:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:53:58.049675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1707ea-d640-4ced-821c-c5dba0d21f0b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:58.051202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-be1707ea-d640-4ced-821c-c5dba0d21f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.100026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:58.154336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1707ea-d640-4ced-821c-c5dba0d21f0b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:58.226364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:58.226967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:58.227278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:58.227554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:58.229763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.326465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:58.327808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:58.331310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:58.347058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 754/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:53:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:53:58.391977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4087-5134-413e-8d79-4d70457aa105 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:58.392266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4087-5134-413e-8d79-4d70457aa105 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:58.392540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4087-5134-413e-8d79-4d70457aa105 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:58.393838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 752/1506] 10.222.0.18 () {52 vars in 830 bytes} [Wed Aug 24 07:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:58.397369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:58.398578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.495698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880bd0-cf41-4f2a-a623-f879b992c967 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:58.587479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:58.588079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:58.588832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:58.589102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] PATH_INFO: `/v3/users/febd3d46462f48a9b7f1c1370bf56c75` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:58.600933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febd3d46462f48a9b7f1c1370bf56c75)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:58.601985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:58.601985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:53:58.601985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:53:58.603201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:58.612641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:58.668169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febd3d46462f48a9b7f1c1370bf56c75'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:58.677425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febd3d46462f48a9b7f1c1370bf56c75'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:58.677928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febd3d46462f48a9b7f1c1370bf56c75'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:58.701411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febd3d46462f48a9b7f1c1370bf56c75'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:58.714626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febd3d46462f48a9b7f1c1370bf56c75'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:58.720155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 755/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:53:58 2022] DELETE /identity/v3/users/febd3d46462f48a9b7f1c1370bf56c75 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:53:58.724476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:58.724949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:58.725075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:58.780092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:58.781315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.855937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:58.869142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 753/1508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:53:58.879193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:58.880448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.981080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce81d1-7d6d-4fc2-ab2b-acf42c6b8da6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.038402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:59.059644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.060252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.060535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.060807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.062440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:59.169748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.171174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffefb3-ac22-4c06-bea4-e8cc49a99a68 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.189726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 756/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:53:59.681167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.682438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:59.694320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fc3f-5b61-4861-8dbf-0e751eca027a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.795586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.796209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.796482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.796754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] PATH_INFO: `/v3/projects/f7900552137347e595e736ece973bce0` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.806461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7900552137347e595e736ece973bce0)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.808086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:59.808086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:53:59.808086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:53:59.809309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.865463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7900552137347e595e736ece973bce0', 'request_id': 'req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:59.878980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7900552137347e595e736ece973bce0', 'request_id': 'req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:59.888174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7900552137347e595e736ece973bce0', 'request_id': 'req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:59.911003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] The token cache is being invalidate because project f7900552137347e595e736ece973bce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:53:59.911330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:59.911754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7a39aa56-a31e-42bf-adb8-8f1d4481d4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:53:59.913147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 754/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:53:59 2022] DELETE /identity/v3/projects/f7900552137347e595e736ece973bce0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:09.187405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=62 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:09.909020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:34.002569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b0a3-e423-49ad-97f1-b1dc70ab3f55 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.003167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b0a3-e423-49ad-97f1-b1dc70ab3f55 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.003167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b0a3-e423-49ad-97f1-b1dc70ab3f55 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.004469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:34.009119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a1e9-8121-4192-8bbf-6b233b784c55 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.009598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a1e9-8121-4192-8bbf-6b233b784c55 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.009708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a1e9-8121-4192-8bbf-6b233b784c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.092504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6f24a1e9-8121-4192-8bbf-6b233b784c55 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:34.093754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6f24a1e9-8121-4192-8bbf-6b233b784c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:34.195075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:34.345225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b0a3-e423-49ad-97f1-b1dc70ab3f55 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:34.347469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8064b0a3-e423-49ad-97f1-b1dc70ab3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:34.468090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b0a3-e423-49ad-97f1-b1dc70ab3f55 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:34.474128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1d01-8929-44e0-8b94-c0f29190a603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:34.474731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1d01-8929-44e0-8b94-c0f29190a603 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.475014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1d01-8929-44e0-8b94-c0f29190a603 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.475288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1d01-8929-44e0-8b94-c0f29190a603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.483321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1d01-8929-44e0-8b94-c0f29190a603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:34.485580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1d01-8929-44e0-8b94-c0f29190a603 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:34.494970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 758/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:35.314935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc6b5d-1286-4267-b39c-6e2e970c2a2b None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.315480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc6b5d-1286-4267-b39c-6e2e970c2a2b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.315480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc6b5d-1286-4267-b39c-6e2e970c2a2b None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.316814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:55:35.321521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311746-39c6-40fb-b16f-08f89d1814f3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.321951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311746-39c6-40fb-b16f-08f89d1814f3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.322056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311746-39c6-40fb-b16f-08f89d1814f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.341965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fb311746-39c6-40fb-b16f-08f89d1814f3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:35.342941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fb311746-39c6-40fb-b16f-08f89d1814f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:35.350707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:35.499572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc6b5d-1286-4267-b39c-6e2e970c2a2b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.514228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc6b5d-1286-4267-b39c-6e2e970c2a2b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.520206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62568e-5a3f-434c-b253-d2c2393add18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.520799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62568e-5a3f-434c-b253-d2c2393add18 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.521075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62568e-5a3f-434c-b253-d2c2393add18 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.521381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62568e-5a3f-434c-b253-d2c2393add18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.529558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62568e-5a3f-434c-b253-d2c2393add18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.531133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62568e-5a3f-434c-b253-d2c2393add18 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.540319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 757/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:36.181186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1474-1317-4efd-92c8-ee8b1ba4ceec None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.181496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1474-1317-4efd-92c8-ee8b1ba4ceec None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.181766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1474-1317-4efd-92c8-ee8b1ba4ceec None None] PATH_INFO: `/v3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.183030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 760/1517] 10.222.0.20 () {54 vars in 925 bytes} [Wed Aug 24 07:55:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:36.189284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f6a28-b5d2-434a-80ef-ab1ef0e7ba9f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.189573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f6a28-b5d2-434a-80ef-ab1ef0e7ba9f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.189849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f6a28-b5d2-434a-80ef-ab1ef0e7ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.246954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-251f6a28-b5d2-434a-80ef-ab1ef0e7ba9f None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:36.248134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-251f6a28-b5d2-434a-80ef-ab1ef0e7ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.264135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:36.317210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 758/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Aug 24 07:55:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:45.336834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=56 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:45.552476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51ab1f-b14d-46ac-a91a-48c6516dbfc3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:45.552679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51ab1f-b14d-46ac-a91a-48c6516dbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:45.552929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51ab1f-b14d-46ac-a91a-48c6516dbfc3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:45.554290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 761/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 24 07:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:45.559209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824672e-4fec-4bcc-a04b-7c8c8d084b47 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:45.559677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824672e-4fec-4bcc-a04b-7c8c8d084b47 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:45.559779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824672e-4fec-4bcc-a04b-7c8c8d084b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:45.578688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1824672e-4fec-4bcc-a04b-7c8c8d084b47 None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:45.579874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1824672e-4fec-4bcc-a04b-7c8c8d084b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:45.588759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 759/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 24 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:45.596021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51ab1f-b14d-46ac-a91a-48c6516dbfc3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:45.609968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51ab1f-b14d-46ac-a91a-48c6516dbfc3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:45.614903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8a9d-7529-47cb-b7f1-6457ee4fa4cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:45.615486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8a9d-7529-47cb-b7f1-6457ee4fa4cc service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:45.615766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8a9d-7529-47cb-b7f1-6457ee4fa4cc service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:45.616038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8a9d-7529-47cb-b7f1-6457ee4fa4cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:45.624059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8a9d-7529-47cb-b7f1-6457ee4fa4cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:45.625666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8a9d-7529-47cb-b7f1-6457ee4fa4cc service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:45.634972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 762/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:46.766326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e307-a6b1-4ee9-8963-3ad4df2870db None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.766922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e307-a6b1-4ee9-8963-3ad4df2870db None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.766922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e307-a6b1-4ee9-8963-3ad4df2870db None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.768202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:46.772934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3768b-e904-4b76-b9ed-4c1747822f2a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.773407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3768b-e904-4b76-b9ed-4c1747822f2a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.773509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3768b-e904-4b76-b9ed-4c1747822f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.793319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-54b3768b-e904-4b76-b9ed-4c1747822f2a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:46.794522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-54b3768b-e904-4b76-b9ed-4c1747822f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:46.802860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:46.955925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e307-a6b1-4ee9-8963-3ad4df2870db None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:46.970153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e307-a6b1-4ee9-8963-3ad4df2870db None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:46.975928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef0824-46c0-47b5-ac15-73d4e1e089da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:46.976517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0824-46c0-47b5-ac15-73d4e1e089da service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.976796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0824-46c0-47b5-ac15-73d4e1e089da service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.977068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0824-46c0-47b5-ac15-73d4e1e089da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.984887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef0824-46c0-47b5-ac15-73d4e1e089da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:46.986484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef0824-46c0-47b5-ac15-73d4e1e089da service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:46.996107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 761/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:47.814564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0ed4-0205-4e86-81b6-c257225a0a14 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.815132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0ed4-0205-4e86-81b6-c257225a0a14 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.815132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0ed4-0205-4e86-81b6-c257225a0a14 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.816428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:47.821127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26912bb-0311-4c62-80d3-a87b9c38b4ae None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.821639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26912bb-0311-4c62-80d3-a87b9c38b4ae None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.821767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26912bb-0311-4c62-80d3-a87b9c38b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.841132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c26912bb-0311-4c62-80d3-a87b9c38b4ae None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:47.842346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c26912bb-0311-4c62-80d3-a87b9c38b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.850642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:48.001458 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0ed4-0205-4e86-81b6-c257225a0a14 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:48.015716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0ed4-0205-4e86-81b6-c257225a0a14 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:48.021738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d1cf-3e9c-43a4-b072-2bc23b20ac33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:48.022327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d1cf-3e9c-43a4-b072-2bc23b20ac33 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:48.022608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d1cf-3e9c-43a4-b072-2bc23b20ac33 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:48.022882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d1cf-3e9c-43a4-b072-2bc23b20ac33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:48.031069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d1cf-3e9c-43a4-b072-2bc23b20ac33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:48.032638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d1cf-3e9c-43a4-b072-2bc23b20ac33 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:48.042381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 765/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:51.831914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a13b7-aa24-4070-9102-3415a8afb50a None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.832483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a13b7-aa24-4070-9102-3415a8afb50a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.832483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a13b7-aa24-4070-9102-3415a8afb50a None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.833855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:51.839034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098ccd4-55c8-4000-8717-592fcfc7947c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.839429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098ccd4-55c8-4000-8717-592fcfc7947c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.839589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098ccd4-55c8-4000-8717-592fcfc7947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.858330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9098ccd4-55c8-4000-8717-592fcfc7947c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:51.859516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9098ccd4-55c8-4000-8717-592fcfc7947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.867996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:52.153793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a13b7-aa24-4070-9102-3415a8afb50a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.155469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-095a13b7-aa24-4070-9102-3415a8afb50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:52.231462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a13b7-aa24-4070-9102-3415a8afb50a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.235044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588e2fa-a411-4710-9a8a-92459a876cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.235645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588e2fa-a411-4710-9a8a-92459a876cae service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.235924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588e2fa-a411-4710-9a8a-92459a876cae service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.236196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588e2fa-a411-4710-9a8a-92459a876cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.245431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588e2fa-a411-4710-9a8a-92459a876cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.246845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588e2fa-a411-4710-9a8a-92459a876cae service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.255974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 764/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:54.137409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d503c-7e44-4573-9835-2e00bee1a9e9 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.137849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d503c-7e44-4573-9835-2e00bee1a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.137957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d503c-7e44-4573-9835-2e00bee1a9e9 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.139278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:54.144485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3403101-40b0-4eac-bb47-eb51a6f056bb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.144914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3403101-40b0-4eac-bb47-eb51a6f056bb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.145024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3403101-40b0-4eac-bb47-eb51a6f056bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.163952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a3403101-40b0-4eac-bb47-eb51a6f056bb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:54.165128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a3403101-40b0-4eac-bb47-eb51a6f056bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:54.172809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:54.457527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d503c-7e44-4573-9835-2e00bee1a9e9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.468255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d503c-7e44-4573-9835-2e00bee1a9e9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.471772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221d84-536a-46d0-9049-882e0ef65293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.472361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221d84-536a-46d0-9049-882e0ef65293 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.473157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221d84-536a-46d0-9049-882e0ef65293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.473467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221d84-536a-46d0-9049-882e0ef65293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.482111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05221d84-536a-46d0-9049-882e0ef65293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.483531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05221d84-536a-46d0-9049-882e0ef65293 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.493517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 768/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:57.882161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ede6de-8935-4ce2-850d-f24e0a048934 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:57.882727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ede6de-8935-4ce2-850d-f24e0a048934 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:57.882727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ede6de-8935-4ce2-850d-f24e0a048934 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:57.884092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:57.889251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04452-89fb-4d79-9599-5df3cd2f128a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:57.889715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04452-89fb-4d79-9599-5df3cd2f128a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:57.889825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04452-89fb-4d79-9599-5df3cd2f128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:57.909726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3bd04452-89fb-4d79-9599-5df3cd2f128a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:57.911465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3bd04452-89fb-4d79-9599-5df3cd2f128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:57.919177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:58.470576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ede6de-8935-4ce2-850d-f24e0a048934 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:58.472254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-49ede6de-8935-4ce2-850d-f24e0a048934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.536798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:58.549979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ede6de-8935-4ce2-850d-f24e0a048934 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:58.554018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2d88-afb7-42df-8e7c-e41a465e9985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:58.554612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2d88-afb7-42df-8e7c-e41a465e9985 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.554888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2d88-afb7-42df-8e7c-e41a465e9985 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.555158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2d88-afb7-42df-8e7c-e41a465e9985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.563765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2d88-afb7-42df-8e7c-e41a465e9985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:58.565177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a2d88-afb7-42df-8e7c-e41a465e9985 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:58.574884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 767/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:00.476332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0703-0d1c-40ec-a055-cc403a7d7d7b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.476908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0703-0d1c-40ec-a055-cc403a7d7d7b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.476908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0703-0d1c-40ec-a055-cc403a7d7d7b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.478267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:00.483457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591af25-7037-4ee1-91a9-808be441644c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.483887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591af25-7037-4ee1-91a9-808be441644c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.484012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591af25-7037-4ee1-91a9-808be441644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.503059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e591af25-7037-4ee1-91a9-808be441644c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:00.504792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e591af25-7037-4ee1-91a9-808be441644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:00.512529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:01.060536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0703-0d1c-40ec-a055-cc403a7d7d7b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.062249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dbec0703-0d1c-40ec-a055-cc403a7d7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.075561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0703-0d1c-40ec-a055-cc403a7d7d7b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.079076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccb2c8-3267-4c53-b524-5ceb74260587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.079665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb2c8-3267-4c53-b524-5ceb74260587 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.079949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb2c8-3267-4c53-b524-5ceb74260587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.080223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb2c8-3267-4c53-b524-5ceb74260587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.089038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccb2c8-3267-4c53-b524-5ceb74260587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.090478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccb2c8-3267-4c53-b524-5ceb74260587 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.100236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 771/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:10.498039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=11 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:11.095623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=33 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:33.816795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:33.817463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:33.817463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:33.842440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:33.843925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:33.857941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 769/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:33.867341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:33.867925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:33.867925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:33.901973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:33.903167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:33.918848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 772/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:33.923783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:33.934907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11418896-b712-4d55-9233-2edaa805fa8f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:33.945591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:33.946487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:33.946966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:33.947441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:33.948293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:33.948806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:33.950634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:33.968521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 770/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:33.977509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:33.995426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd3b7-20e9-48b0-ac7d-e8ad86e28e01 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.002820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.003434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.003711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.003985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.004628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.006542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.069365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 773/1543] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:33 2022] POST /identity/v3/projects => generated 403 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:34.074609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.090878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3a69-6c9d-4300-a24e-c626642e5d2d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.180271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2756c9-fb1b-46ec-a8d4-327063d091ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.180904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2756c9-fb1b-46ec-a8d4-327063d091ad admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.181180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2756c9-fb1b-46ec-a8d4-327063d091ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.181477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2756c9-fb1b-46ec-a8d4-327063d091ad admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.182106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2756c9-fb1b-46ec-a8d4-327063d091ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.184024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2756c9-fb1b-46ec-a8d4-327063d091ad admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.218551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 771/1544] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/users => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:34.223600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.235062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6d55a-e385-41fb-a707-a6c452eba0f9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.248554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.249192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.249507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.249783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.250433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.252332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.270620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 774/1545] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:34.273587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10c0f-e23d-4287-8745-2eea51d14043 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.273875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10c0f-e23d-4287-8745-2eea51d14043 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.274150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10c0f-e23d-4287-8745-2eea51d14043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.276500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.292463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae0c2-96f9-4267-992d-0c7f6e6e757e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.306161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.306802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.307089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.307374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.308025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.309902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.316362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-25e10c0f-e23d-4287-8745-2eea51d14043 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.317612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-25e10c0f-e23d-4287-8745-2eea51d14043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.328335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 775/1546] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:57:34.333056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.336424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 772/1547] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:34.347507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.347507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.347507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.356961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00f39-9791-46d4-b252-ebb740d20b00 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.374871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155603d-0135-49c7-8805-80bc6d2e1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.375692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155603d-0135-49c7-8805-80bc6d2e1602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.375980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155603d-0135-49c7-8805-80bc6d2e1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.376257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155603d-0135-49c7-8805-80bc6d2e1602 admin admin] PATH_INFO: `/v3/projects/185586ef729f47afa5e33ddaf12cb51d/users/bfa34bc1db91486a9c6fadc90ec6d6fe/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.414062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.415881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.422129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155603d-0135-49c7-8805-80bc6d2e1602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185586ef729f47afa5e33ddaf12cb51d, user_id=bfa34bc1db91486a9c6fadc90ec6d6fe, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.425440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155603d-0135-49c7-8805-80bc6d2e1602 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.431817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 773/1548] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:34.436546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.449760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadef30a-e5ba-4a18-8500-ab7aaad4f259 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.452494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 776/1549] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:34 2022] PUT /identity/v3/projects/185586ef729f47afa5e33ddaf12cb51d/users/bfa34bc1db91486a9c6fadc90ec6d6fe/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:57:34.454695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7194a-a8c5-43aa-a479-1d78bb364007 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.454978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7194a-a8c5-43aa-a479-1d78bb364007 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.457656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7194a-a8c5-43aa-a479-1d78bb364007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.503652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ddc7194a-a8c5-43aa-a479-1d78bb364007 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.504882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ddc7194a-a8c5-43aa-a479-1d78bb364007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.565022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.566469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.566758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.567032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.567682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:34.567986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.569617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ea6b7-c3f6-4e66-b33e-3a24ee7c3053 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.586787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 774/1550] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:34.588000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efc884-c4ef-49c0-bb81-e2325971ab27 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.588281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efc884-c4ef-49c0-bb81-e2325971ab27 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.588554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efc884-c4ef-49c0-bb81-e2325971ab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.601439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 777/1551] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.602863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf50998-ac46-4861-b4e5-7c9c9e48e4f9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.603159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf50998-ac46-4861-b4e5-7c9c9e48e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.603440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf50998-ac46-4861-b4e5-7c9c9e48e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.619694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-75efc884-c4ef-49c0-bb81-e2325971ab27 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.620903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-75efc884-c4ef-49c0-bb81-e2325971ab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.628931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 775/1552] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.630201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687921c-17e1-43ff-8ac5-cdc62e260f0a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.630482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687921c-17e1-43ff-8ac5-cdc62e260f0a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.630751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687921c-17e1-43ff-8ac5-cdc62e260f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.632976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-bdf50998-ac46-4861-b4e5-7c9c9e48e4f9 None None] MFA Rules not processed for user `bfa34bc1db91486a9c6fadc90ec6d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.634231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bdf50998-ac46-4861-b4e5-7c9c9e48e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.654590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1687921c-17e1-43ff-8ac5-cdc62e260f0a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.655809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1687921c-17e1-43ff-8ac5-cdc62e260f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.663728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 776/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.665945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.666229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.666509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.685080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.686522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.694450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 777/1554] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.696361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.701316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 778/1555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.701856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712265c-6f09-4287-ba20-0e03431deef4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.702234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712265c-6f09-4287-ba20-0e03431deef4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.702512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712265c-6f09-4287-ba20-0e03431deef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.706923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a991f0-3d4c-42ee-81de-e6ab34a755f4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.712368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.712959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.713233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.713534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.714150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.715160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:34.715160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:57:34.715160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:57:34.716343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e532b6-8d93-43ed-8c6e-7cfbe1702153 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.716486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:34.722598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c712265c-6f09-4287-ba20-0e03431deef4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.724193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c712265c-6f09-4287-ba20-0e03431deef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.732230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 779/1556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.733525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438fc0b-5595-452e-b756-22c7daba862a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.733828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438fc0b-5595-452e-b756-22c7daba862a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.734183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438fc0b-5595-452e-b756-22c7daba862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.747507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 778/1557] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:34.748819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f5b14-69a1-492b-a8a7-ae545ccbc859 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.749103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f5b14-69a1-492b-a8a7-ae545ccbc859 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.749408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f5b14-69a1-492b-a8a7-ae545ccbc859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.756024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2438fc0b-5595-452e-b756-22c7daba862a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.757821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2438fc0b-5595-452e-b756-22c7daba862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.768654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-086f5b14-69a1-492b-a8a7-ae545ccbc859 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.769851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-086f5b14-69a1-492b-a8a7-ae545ccbc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.774760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:34.817320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 780/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.818566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcd17-1310-4e87-afd7-9c5a3b2dc06a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.818851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcd17-1310-4e87-afd7-9c5a3b2dc06a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.819127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcd17-1310-4e87-afd7-9c5a3b2dc06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.833559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 779/1559] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.838670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84967f16-6b97-497f-872f-edce8adac064 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.838917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8c9dcd17-1310-4e87-afd7-9c5a3b2dc06a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.839120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84967f16-6b97-497f-872f-edce8adac064 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.839484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84967f16-6b97-497f-872f-edce8adac064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.840112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8c9dcd17-1310-4e87-afd7-9c5a3b2dc06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.848004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 781/1560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.849172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c4979-ca1e-4619-8be7-8ac64ed216da None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.849487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c4979-ca1e-4619-8be7-8ac64ed216da None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.849758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c4979-ca1e-4619-8be7-8ac64ed216da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.859444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-84967f16-6b97-497f-872f-edce8adac064 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.860650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-84967f16-6b97-497f-872f-edce8adac064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.868938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 780/1561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.869733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84967f16-6b97-497f-872f-edce8adac064 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.873739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-261c4979-ca1e-4619-8be7-8ac64ed216da None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.874942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-261c4979-ca1e-4619-8be7-8ac64ed216da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.879023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84967f16-6b97-497f-872f-edce8adac064 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.883603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 782/1562] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.884016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.884598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.884809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.884931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.885029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.885111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.885341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.885759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.887630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.905217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:34.906550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:34.918329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 783/1563] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:34.918329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.918593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 781/1564] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:34.918593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:34.924526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ced754-3b47-47da-b434-e4179cca9042 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.982201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.982810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.983088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.983226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8813e-de64-4c3c-b6a3-81816116d846 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:34.983360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.983971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.985010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:34.985010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:57:34.985010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:57:34.986372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:34.987830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:34.988424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:34.988699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:34.988972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:34.989640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:34.989940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:34.992052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159de96-3267-4d9e-8280-c9661ed3d4a7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.004225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 782/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:35.005858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.006252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.006603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.015273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 784/1566] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:34 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.016266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.026464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a4f3-07b4-4d0c-94f5-a090d3bcf16d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.027711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:35.028923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:35.031364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.031985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.032265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.032538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.033180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:35.033543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.034545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:35.034545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:57:35.034545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:57:35.035425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.041035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 783/1567] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:35.041035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.047241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51f269-85a9-465e-974e-4a4c394daf05 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.048866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 785/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:35.049693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.052026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.052618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.052907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.053184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.053855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:35.054812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.056643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.061231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26ded-d86f-4651-8ae5-3acee6d8282e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.066426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.067018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.067296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.067569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.068191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:35.068509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.068739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 784/1569] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:35.069735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.076154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.079994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc0b6-39d3-4614-ad8b-6fdf3113f4c1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.085492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.086088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.086374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.086653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.087318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:35.087688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.087881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 786/1570] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:35.088644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.089486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.098223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18737b8-7bd4-40f8-bdbc-2819f40c917e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.102830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.103412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.103687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.103958 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.104559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.111933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 785/1571] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:35.112082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.112189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.117118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cbb6a-0716-4020-9da0-f4e66c7353c9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.122345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.122986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.123265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.123533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.124145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.126069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.131487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 787/1572] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 309 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.131487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.140392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daab0e-767f-461a-8930-f74a9e2e642e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.145887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.146723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.147063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.147386 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.148102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.149731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.155090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 786/1573] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.155973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.166572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 788/1574] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.166572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.174069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053942-94c8-44b8-870a-5f619dca4a6f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.178819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.187844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.223359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba6e6-da06-4fd8-928a-3388a08c0324 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.228190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.228695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.228980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.229270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.229925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:35.230263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.231873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.232453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.233062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.233369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.233637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.234244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.236102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.243860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 787/1575] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:35.244640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.253891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba0f35-810c-46bf-879b-4a532dd55181 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.259194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.259784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.260060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.260377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.261108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.263030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.270526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 789/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.270526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.293020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 788/1577] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.293977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.330498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ccb4-8123-4bd0-a251-a05813577d80 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.361887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ad184-8808-4c78-a21e-91d914b49ca3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.367208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.367820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.368106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.368383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.369011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.371305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.390178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.390939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.391221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.391524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.392169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.394148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.401134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 789/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.401134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.422609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 790/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.423433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.460318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.462795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653d23-11cc-4f57-90b0-e30872374fda admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.484231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.489175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafc10-db0d-4e6d-992a-5a206459419d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.494780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.495389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.495665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.495938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.496550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.498493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.519857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 791/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.520973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.522292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.523551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.523837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.524120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.524762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.526672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.532684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266192-884f-4205-a641-7616a3c8352e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.536731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 790/1581] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.537472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.537598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.538063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.538844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.539139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.539766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.541362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.549109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c53d3f-8ce1-4cd3-9868-cc6592f94bfb admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.551467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 792/1582] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.552287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.554709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.555306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.555581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.555851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.556491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.558421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.564703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c12fb-eb39-4bed-b624-76736a2d219a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.570166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.570754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.571039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.571316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.572046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.574017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.584569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 791/1583] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.585449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.596479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 793/1584] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.597310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.607258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f272fb0-9712-41ab-bc75-7eab62d0ca64 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.649325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516695-a765-40fc-9afa-f6d423ebf418 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.654301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.654940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.655219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.655487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.656100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.658046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.665468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.666080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.666546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.666878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.667451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.669805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.680119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 792/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.681055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.692191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 794/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.693078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.693615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded45da-309e-45f7-9183-9a7b30c76daf admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.698575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.699281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.699658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.700034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.700666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.702589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.703855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52ea2d-58cf-41c3-815c-a25690cf5699 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.709023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.709627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.709908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.710181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.711349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.713399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.727867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 793/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.727867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.728141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 795/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.728141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.737049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505cb24-5b20-4e04-a906-bf28945db202 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.737765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db105b-c965-41ab-8a3a-57952229fde1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.741964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.742376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.742598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.742888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.743005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.743183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] PATH_INFO: `/v3/projects/a1783437d8ee40e6bb1d95fbabb185d9/users/39d380ad69d9417a86f88f45341b68a7/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.743286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.743546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] PATH_INFO: `/v3/projects/29ad068df99646ed992a31259128fca4/users/3038aaf4498540009882a4c0b9ea86dd/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.758372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1783437d8ee40e6bb1d95fbabb185d9, user_id=39d380ad69d9417a86f88f45341b68a7, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.758765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ad068df99646ed992a31259128fca4, user_id=3038aaf4498540009882a4c0b9ea86dd, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.759772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:35.759772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:57:35.759772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:57:35.760996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.761791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.774822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 796/1589] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:35 2022] PUT /identity/v3/projects/a1783437d8ee40e6bb1d95fbabb185d9/users/39d380ad69d9417a86f88f45341b68a7/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:35.775666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.779071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 794/1590] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:35 2022] PUT /identity/v3/projects/29ad068df99646ed992a31259128fca4/users/3038aaf4498540009882a4c0b9ea86dd/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:35.779071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.825044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.825568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.841418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40202c4-b6c9-4e44-b2af-c454aa8473db admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.842440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f038ea-1c5c-4a4b-bfaa-e4988b948799 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.846107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.846770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.847003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.847115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.847276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.847630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.847907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.848004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.848179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.848800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.849678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.850721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.860570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 795/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.861513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.871647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd310ac-c1d3-408e-82a9-e05af82c429c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.873462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 797/1592] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:35.874502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.877163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.877874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.878221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.878561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.879251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.880893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.884544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7ad33-820f-4ba8-b49c-da22fbbbcf6c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.889291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.889868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.890152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.890453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.894050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 796/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.894195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.894293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.894383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.901923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ba2e8-b680-4004-8534-5d92d04a7706 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.904263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 798/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.904396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.906686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a603bd-1a94-4486-a08d-3a8c978c8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.907311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a603bd-1a94-4486-a08d-3a8c978c8cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.907587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a603bd-1a94-4486-a08d-3a8c978c8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.907860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a603bd-1a94-4486-a08d-3a8c978c8cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.908507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a603bd-1a94-4486-a08d-3a8c978c8cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.910119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a603bd-1a94-4486-a08d-3a8c978c8cc5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.914254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da565-a3c5-4531-a37e-b0ab169494f1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.918856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.919442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.919726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.920000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.920617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.921339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 797/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.922237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.922562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.922844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.923113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.933865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 799/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.934668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.941068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:35.942295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:35.944098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebfcc4-6078-4fb5-ad48-d681026235a9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.948663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.949242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.949553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.949968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 798/1597] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:35.950090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.950451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.950553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.952003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.961208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0adcd-8020-4fbd-9e4d-b5e0f2fbfa4f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.967586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 800/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.967586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.969117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.969751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.970033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.970310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.970948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.972533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.974825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fab68-6ce9-459b-b288-485af210ff50 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.979899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.980467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.980745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.981013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.981653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.983197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.983959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 799/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.984863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.993705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 801/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:35.994620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.997655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a848b-a087-4fc0-8da8-70d5b5cd46ba admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.002327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.002920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.003197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.003467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.004092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.004198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b805f8-7027-45f6-a6de-5527f9a3a43f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.005691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.009414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.009991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.010275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.010549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.011622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.013180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.018621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 800/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:36.018621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.026332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 802/1602] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:36.026534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318fb39-d8a1-4dc9-b218-1247110a81e7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.027123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.031358 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.031948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.032227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.032524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.033147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.034785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.037484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e88da-e880-491e-8d77-c9fb0cf74285 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.042895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.043583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.043868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.044162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] PATH_INFO: `/v3/projects/31a9faee867742ae99bc4938ab03b236/users/412a8703f2d44e95ab52d655316404bd/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.047898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 801/1603] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:36.047898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.059360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a9faee867742ae99bc4938ab03b236, user_id=412a8703f2d44e95ab52d655316404bd, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.062266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.077012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 803/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/31a9faee867742ae99bc4938ab03b236/users/412a8703f2d44e95ab52d655316404bd/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.081600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.104938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e59d01-7f38-4152-bd1b-4d8e5b16f7dd admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.142486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6cd4-bd97-4fdb-b25c-98d794e05638 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.147184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.148442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.148725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.149002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] PATH_INFO: `/v3/projects/29ad068df99646ed992a31259128fca4/users/3038aaf4498540009882a4c0b9ea86dd/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.151198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ad068df99646ed992a31259128fca4, user_id=3038aaf4498540009882a4c0b9ea86dd, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.153520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.154132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.154278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.154414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.154691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.164263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.165164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 804/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/29ad068df99646ed992a31259128fca4/users/3038aaf4498540009882a4c0b9ea86dd/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.165734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.170347 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.176165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 802/1606] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:36.177285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.188292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc778c-a64e-4d01-92aa-8a7f48e26c92 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.236832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:36.237475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:36.254339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f333f56-9294-40b8-9cda-3b45b5c26186 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.261548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.262255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.262512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.262777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] PATH_INFO: `/v3/projects/b950f7a00f104a8aba30fe929bba0dd6/users/85637ddc957645339d4f92a909442640/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.262966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.263610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.263886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.264194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.264807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.266650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.278376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 803/1607] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:36.279389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.281995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b950f7a00f104a8aba30fe929bba0dd6, user_id=85637ddc957645339d4f92a909442640, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.284653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.289896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398a093-8232-4f6d-be1c-24c4f08d8a43 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.295331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.296043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.296341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.296603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] PATH_INFO: `/v3/projects/f228e2b03d3d418db3d6c678a3aaa3bc/users/02ff7594912f40adb14db63d5ea0e6a6/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.303028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 805/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/b950f7a00f104a8aba30fe929bba0dd6/users/85637ddc957645339d4f92a909442640/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.303028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.318702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f228e2b03d3d418db3d6c678a3aaa3bc, user_id=02ff7594912f40adb14db63d5ea0e6a6, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.322026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.337028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 804/1609] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/f228e2b03d3d418db3d6c678a3aaa3bc/users/02ff7594912f40adb14db63d5ea0e6a6/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.341062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.396047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603283e-2a19-4805-a9a3-a92798848b33 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.414413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfde96-6fb8-47c0-8851-97dc05279773 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.421071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86f97-0863-4af9-94cf-d8e06756f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.421924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86f97-0863-4af9-94cf-d8e06756f494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.422155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86f97-0863-4af9-94cf-d8e06756f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.422437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86f97-0863-4af9-94cf-d8e06756f494 admin admin] PATH_INFO: `/v3/projects/ecad2083ff8b46e0aa90603461f1f4ae/users/fbcbd773fcea411994b925b7f9ff1def/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.445121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c86f97-0863-4af9-94cf-d8e06756f494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecad2083ff8b46e0aa90603461f1f4ae, user_id=fbcbd773fcea411994b925b7f9ff1def, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.448638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c86f97-0863-4af9-94cf-d8e06756f494 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.464807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 805/1610] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/ecad2083ff8b46e0aa90603461f1f4ae/users/fbcbd773fcea411994b925b7f9ff1def/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.466122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.466652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.466652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.479654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70b4b0-3f98-4d77-91ba-92baebdcdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.480338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b4b0-3f98-4d77-91ba-92baebdcdef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.480615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b4b0-3f98-4d77-91ba-92baebdcdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.481607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b4b0-3f98-4d77-91ba-92baebdcdef8 admin admin] PATH_INFO: `/v3/projects/df48207a33bf4299a4e35a16879071f8/users/d67fb10a8a4a4dc188c3f4e50a277a83/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.493443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:36.494911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.499737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70b4b0-3f98-4d77-91ba-92baebdcdef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df48207a33bf4299a4e35a16879071f8, user_id=d67fb10a8a4a4dc188c3f4e50a277a83, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.502525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70b4b0-3f98-4d77-91ba-92baebdcdef8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.521792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 806/1611] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/df48207a33bf4299a4e35a16879071f8/users/d67fb10a8a4a4dc188c3f4e50a277a83/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.524361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978699-6840-481b-96bf-a35063bcc93f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.524658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978699-6840-481b-96bf-a35063bcc93f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.524936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978699-6840-481b-96bf-a35063bcc93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.559961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fc978699-6840-481b-96bf-a35063bcc93f None None] MFA Rules not processed for user `3038aaf4498540009882a4c0b9ea86dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:36.561183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fc978699-6840-481b-96bf-a35063bcc93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.570697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 806/1612] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:36.570697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.578610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9475d-7bd4-49e6-ae45-64b7ade3f7a1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.623605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:36.633279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:36.656268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dc550-068f-4df8-8aed-6e0f7ccd0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.657138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc550-068f-4df8-8aed-6e0f7ccd0529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.657502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc550-068f-4df8-8aed-6e0f7ccd0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.657892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc550-068f-4df8-8aed-6e0f7ccd0529 admin admin] PATH_INFO: `/v3/projects/f91ee18a75b14103ac14edef023b1ce3/users/e8e5a0df4ec54ab495a007f8804f23b4/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.662083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 807/1613] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:36.662083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c60a-ef3b-4034-98bf-80befdb78666 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.662083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c60a-ef3b-4034-98bf-80befdb78666 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.662083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c60a-ef3b-4034-98bf-80befdb78666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.678175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dc550-068f-4df8-8aed-6e0f7ccd0529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91ee18a75b14103ac14edef023b1ce3, user_id=e8e5a0df4ec54ab495a007f8804f23b4, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:36.686680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-7362c60a-ef3b-4034-98bf-80befdb78666 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:36.687970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7362c60a-ef3b-4034-98bf-80befdb78666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.699854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 808/1614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:36.702070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02629-eb8a-432e-9ed0-be7fcbcdd015 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.702070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02629-eb8a-432e-9ed0-be7fcbcdd015 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.702323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dc550-068f-4df8-8aed-6e0f7ccd0529 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:36.702524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02629-eb8a-432e-9ed0-be7fcbcdd015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.726644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 807/1615] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:36 2022] PUT /identity/v3/projects/f91ee18a75b14103ac14edef023b1ce3/users/e8e5a0df4ec54ab495a007f8804f23b4/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:36.726644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.726644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.726644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.736459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b2f02629-eb8a-432e-9ed0-be7fcbcdd015 None None] MFA Rules not processed for user `02ff7594912f40adb14db63d5ea0e6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:36.738007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b2f02629-eb8a-432e-9ed0-be7fcbcdd015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.765842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] MFA Rules not processed for user `fbcbd773fcea411994b925b7f9ff1def`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:36.767205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.826793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 809/1616] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:36.828488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.828776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.829054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.844571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 808/1617] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:36.845492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:36.847546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.862210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:36.863380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:36.923722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1307-be0d-405f-8cad-95d95f83edcc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:36.929513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:36.929904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:36.930543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:36.930543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:36.948159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 810/1618] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:36.949423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.032166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0b8fa-ba86-40ea-a1d3-82f31e321b3a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.036312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8e18e-8dc6-43cd-9a18-f1446e610d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.036937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8e18e-8dc6-43cd-9a18-f1446e610d03 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.037222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8e18e-8dc6-43cd-9a18-f1446e610d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.037583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8e18e-8dc6-43cd-9a18-f1446e610d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.056691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.058206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.063349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:37.071812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 809/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.073520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.092764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:37.106027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf80f7-7642-4ea8-840a-6296cace9c7b service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.119254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.119892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.120435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.120716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.134570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8e18e-8dc6-43cd-9a18-f1446e610d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.135940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8e18e-8dc6-43cd-9a18-f1446e610d03 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.138520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.140378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.147439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 811/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.149446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f38c3-e26a-4cf3-ab6d-fcfbd80af704 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.149740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f38c3-e26a-4cf3-ab6d-fcfbd80af704 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.150022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f38c3-e26a-4cf3-ab6d-fcfbd80af704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.154293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 810/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.155144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.167005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecb763-196d-4902-870d-61bf700d2d8f service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.170903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-814f38c3-e26a-4cf3-ab6d-fcfbd80af704 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:37.171578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba8d8d-e326-4b39-a11e-5080de41c24a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.172195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8d8d-e326-4b39-a11e-5080de41c24a service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.172404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-814f38c3-e26a-4cf3-ab6d-fcfbd80af704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:37.172540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8d8d-e326-4b39-a11e-5080de41c24a service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.172741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8d8d-e326-4b39-a11e-5080de41c24a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.182649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 812/1622] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:37.186223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba8d8d-e326-4b39-a11e-5080de41c24a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.186448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b70f01-c171-4877-9799-5bbb3d149eab None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.186448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b70f01-c171-4877-9799-5bbb3d149eab None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.186448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b70f01-c171-4877-9799-5bbb3d149eab None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.187160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba8d8d-e326-4b39-a11e-5080de41c24a service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.187246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 813/1623] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 07:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:37.187586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b70f01-c171-4877-9799-5bbb3d149eab None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.205371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b70f01-c171-4877-9799-5bbb3d149eab None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.210481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.211264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.211552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.211832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.213151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 811/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.214798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.215524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.216109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.227047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.229708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.249840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 814/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.250879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.262206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e06f78-5275-4d9a-9575-13d658c91fa9 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.267430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.268315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.268690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.269060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.271649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:37.273412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:37.291746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.293774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.307345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 815/1626] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.401954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 812/1627] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 07:57:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:37.411240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.432463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ca1e-0596-47c4-ab0d-f0936f956b89 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.450204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b071dd-8283-40ef-b4c4-9f41e92a2aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.451726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b071dd-8283-40ef-b4c4-9f41e92a2aca service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.452015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b071dd-8283-40ef-b4c4-9f41e92a2aca service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.454218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b071dd-8283-40ef-b4c4-9f41e92a2aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.484102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:37.500216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b071dd-8283-40ef-b4c4-9f41e92a2aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.506096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b071dd-8283-40ef-b4c4-9f41e92a2aca service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.516084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e9fcb-2136-49b3-b276-28c585e058cd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:37.541570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:37.542266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.542547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.543394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] PATH_INFO: `/v3/users/bfa34bc1db91486a9c6fadc90ec6d6fe` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.544714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa34bc1db91486a9c6fadc90ec6d6fe)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:37.545823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: WARNING py.warnings [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:37.545823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: warnings.warn(msg) Aug 24 07:57:37.545823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: Aug 24 07:57:37.551471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:37.557589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 816/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.678842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa34bc1db91486a9c6fadc90ec6d6fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:37.680447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa34bc1db91486a9c6fadc90ec6d6fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:37.690777 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa34bc1db91486a9c6fadc90ec6d6fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:37.731489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa34bc1db91486a9c6fadc90ec6d6fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:37.747209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5e35a6c0-55ab-4f39-a976-a67dfc0c7a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa34bc1db91486a9c6fadc90ec6d6fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:37.765123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.765498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.765705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.774593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 813/1629] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:37 2022] DELETE /identity/v3/users/bfa34bc1db91486a9c6fadc90ec6d6fe => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:37.789992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:37.794421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:37.890711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb02e-b8b1-42d1-8df0-3c6da4257a06 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.891204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb02e-b8b1-42d1-8df0-3c6da4257a06 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.891296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb02e-b8b1-42d1-8df0-3c6da4257a06 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.892874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 814/1630] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 07:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:57:37.900277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.900277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.900277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.933964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:37.939064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:37.985007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 817/1631] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:37.988708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:38.084538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 815/1632] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 07:57:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:38.109151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:38.110104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:38.112306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:38.112452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:38.195123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb0311-b656-41f6-b976-54b1a0a1794c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:38.202631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ece10c-f6cc-4766-ab5f-c2afc2ff81fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:38.203382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ece10c-f6cc-4766-ab5f-c2afc2ff81fc service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:38.203772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ece10c-f6cc-4766-ab5f-c2afc2ff81fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:38.204116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ece10c-f6cc-4766-ab5f-c2afc2ff81fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:38.221954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ece10c-f6cc-4766-ab5f-c2afc2ff81fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:38.225098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ece10c-f6cc-4766-ab5f-c2afc2ff81fc service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:38.265095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c059ffd-ab60-4553-961f-d1e27bcc1b56 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:38.270120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9aa09-a2a5-47fb-acfb-303ec5256e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:38.270942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9aa09-a2a5-47fb-acfb-303ec5256e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:38.271060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 818/1633] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:38.271229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9aa09-a2a5-47fb-acfb-303ec5256e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:38.271559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9aa09-a2a5-47fb-acfb-303ec5256e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:38.301724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9aa09-a2a5-47fb-acfb-303ec5256e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:38.303430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9aa09-a2a5-47fb-acfb-303ec5256e1a service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:38.345315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 816/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:39.435103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588363a-a31b-4110-a6a5-7f3c6b446b6b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:39.435700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588363a-a31b-4110-a6a5-7f3c6b446b6b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:39.435700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588363a-a31b-4110-a6a5-7f3c6b446b6b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:39.437541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 819/1635] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 07:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:39.445663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6f171-26b4-4fd5-bbd0-6b8107b15a20 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:39.446150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6f171-26b4-4fd5-bbd0-6b8107b15a20 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:39.446236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6f171-26b4-4fd5-bbd0-6b8107b15a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:39.488996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-26a6f171-26b4-4fd5-bbd0-6b8107b15a20 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:39.488996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-26a6f171-26b4-4fd5-bbd0-6b8107b15a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:39.520205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 817/1636] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 07:57:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:39.527624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589840-1dc1-47c4-bea3-323ce9a95bd7 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:39.528044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589840-1dc1-47c4-bea3-323ce9a95bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:39.528460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589840-1dc1-47c4-bea3-323ce9a95bd7 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:39.531668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 820/1637] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 07:57:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:39.538050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:39.539233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:39.539757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:39.592897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:39.597802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:39.636622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 818/1638] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 07:57:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:39.656134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589840-1dc1-47c4-bea3-323ce9a95bd7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:39.658607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-25589840-1dc1-47c4-bea3-323ce9a95bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:39.698137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589840-1dc1-47c4-bea3-323ce9a95bd7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:39.715707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:39.715707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:39.715707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:39.716180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:39.743025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:39.749777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:39.772430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 821/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:40.885283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:40.886859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:40.911912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fb033-e229-4c6d-b91b-21a65658e0a4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:40.928601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:40.930850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:40.931133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:40.931401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] PATH_INFO: `/v3/projects/185586ef729f47afa5e33ddaf12cb51d` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:40.933121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=185586ef729f47afa5e33ddaf12cb51d)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:40.935127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:41.073169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185586ef729f47afa5e33ddaf12cb51d', 'request_id': 'req-92e1747f-9140-437e-a65d-1ced4fcfc29e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.082813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185586ef729f47afa5e33ddaf12cb51d', 'request_id': 'req-92e1747f-9140-437e-a65d-1ced4fcfc29e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.100909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185586ef729f47afa5e33ddaf12cb51d', 'request_id': 'req-92e1747f-9140-437e-a65d-1ced4fcfc29e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.115254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] The token cache is being invalidate because project 185586ef729f47afa5e33ddaf12cb51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:41.116214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.117836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.119946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 819/1640] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:40 2022] DELETE /identity/v3/projects/185586ef729f47afa5e33ddaf12cb51d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:41.123638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:41.137789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc872a4-82fc-40fe-ac75-2a9a032ee08c service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:41.145169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:41.263838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:41.265542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:41.266000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:41.266590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] PATH_INFO: `/v3/users/3038aaf4498540009882a4c0b9ea86dd` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:41.268783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3038aaf4498540009882a4c0b9ea86dd)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:41.271431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:41.369016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3038aaf4498540009882a4c0b9ea86dd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.389077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3038aaf4498540009882a4c0b9ea86dd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.389849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3038aaf4498540009882a4c0b9ea86dd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.407548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3038aaf4498540009882a4c0b9ea86dd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.418245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b434bd5f-8a76-4d0e-8fbe-16c969e840cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3038aaf4498540009882a4c0b9ea86dd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.427716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 822/1641] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:41 2022] DELETE /identity/v3/users/3038aaf4498540009882a4c0b9ea86dd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:42.305554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:42.307714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:42.340240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1747f-9140-437e-a65d-1ced4fcfc29e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:42.448348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:42.508177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:42.509246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:42.514216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:42.514753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] PATH_INFO: `/v3/projects/29ad068df99646ed992a31259128fca4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:42.516229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ad068df99646ed992a31259128fca4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:42.518962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:42.675768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ad068df99646ed992a31259128fca4', 'request_id': 'req-8c357ec1-e7f1-4227-bad7-1d4709cfda89'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.713936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ad068df99646ed992a31259128fca4', 'request_id': 'req-8c357ec1-e7f1-4227-bad7-1d4709cfda89'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.734585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ad068df99646ed992a31259128fca4', 'request_id': 'req-8c357ec1-e7f1-4227-bad7-1d4709cfda89'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.774723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] The token cache is being invalidate because project 29ad068df99646ed992a31259128fca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:42.775082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.778208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8c357ec1-e7f1-4227-bad7-1d4709cfda89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.784370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 820/1642] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:42 2022] DELETE /identity/v3/projects/29ad068df99646ed992a31259128fca4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:42.785923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:42.786995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:42.787438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:42.835881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:42.839981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.042294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 823/1643] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:43.049473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.050106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.050597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.092393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:43.094007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.110224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 821/1644] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:43.115135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.132591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c94b0a-26a7-431c-83eb-19248fcd4d23 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.150477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.151491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.151773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.152044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.152690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:43.152992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.159890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.206478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 824/1645] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:57:43.208047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.229854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4327a-70db-4a2b-8422-78a66a266f38 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.250098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.251039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.251617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.252027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.252923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.255140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.309932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 822/1646] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:43.314813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.328429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f489d-96d4-4bac-933d-8d5a7c34a822 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.385044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:43.523028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.523875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.525344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.526275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.538704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.538704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.579286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 825/1647] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:43.584031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.599786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f371bfa-d16c-4f00-8538-1098661b5038 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.611521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.612160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.612439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.612708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.613398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.617126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.660513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 823/1648] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:43.661166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.680753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e33a-ca7d-4dee-815a-96abc9277d76 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.694416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a9574-26b9-4eb4-bde7-45b15f749fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.695198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a9574-26b9-4eb4-bde7-45b15f749fda admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.697248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a9574-26b9-4eb4-bde7-45b15f749fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.697689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a9574-26b9-4eb4-bde7-45b15f749fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.699169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a9574-26b9-4eb4-bde7-45b15f749fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.701218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a9574-26b9-4eb4-bde7-45b15f749fda admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.734724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 826/1649] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:43.739410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.756265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5dfa8-38b4-408f-9f27-bc9a1b2658d6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.768320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.769353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.769771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.770183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] PATH_INFO: `/v3/projects/9d6289e5f4784aedabc8bc3a90327378/users/703e8f7de46341bb92ebc938ba45cda6/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.808159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6289e5f4784aedabc8bc3a90327378, user_id=703e8f7de46341bb92ebc938ba45cda6, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.811070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.838377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 824/1650] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:43 2022] PUT /identity/v3/projects/9d6289e5f4784aedabc8bc3a90327378/users/703e8f7de46341bb92ebc938ba45cda6/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:43.843625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.844524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.844996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.895232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:43.896764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.070413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 827/1651] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:44.112934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.118155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.304421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0493c-e076-42e6-bf88-c1a72b34ff03 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.322917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23175524-0770-4408-82b1-e05031dbfe65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.323539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23175524-0770-4408-82b1-e05031dbfe65 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.323820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23175524-0770-4408-82b1-e05031dbfe65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.324262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23175524-0770-4408-82b1-e05031dbfe65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.332186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:44.339426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23175524-0770-4408-82b1-e05031dbfe65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.341548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23175524-0770-4408-82b1-e05031dbfe65 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.369073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.371437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.389853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97d4ee-3936-4358-8a7c-09ffaaa55a84 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.395637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 825/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:44.411574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.412317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.412668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.413081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] PATH_INFO: `/v3/users/fbcbd773fcea411994b925b7f9ff1def` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.414653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbcbd773fcea411994b925b7f9ff1def)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.417582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.507775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbcbd773fcea411994b925b7f9ff1def'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:44.517621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbcbd773fcea411994b925b7f9ff1def'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:44.518573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbcbd773fcea411994b925b7f9ff1def'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:44.534203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbcbd773fcea411994b925b7f9ff1def'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:44.543733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbcbd773fcea411994b925b7f9ff1def'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:44.554694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:44 2022] DELETE /identity/v3/users/fbcbd773fcea411994b925b7f9ff1def => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:44.561503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f7e6b-5f45-4f14-8d58-b836dc079745 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.562246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f7e6b-5f45-4f14-8d58-b836dc079745 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.562732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f7e6b-5f45-4f14-8d58-b836dc079745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.620114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8f4f7e6b-5f45-4f14-8d58-b836dc079745 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:44.624077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8f4f7e6b-5f45-4f14-8d58-b836dc079745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.790586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 826/1654] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:44.910129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.912892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.936081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:45.139700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff666a3-f294-4598-a9ac-6f0305bba7c8 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:45.165117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:45.165998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:45.167236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:45.167532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:45.194924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:45.196799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:45.232300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 829/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:47.061698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:47.063036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:47.064262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:47.123888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] MFA Rules not processed for user `703e8f7de46341bb92ebc938ba45cda6`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:47.127272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:47.312259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 827/1656] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:47.316181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:47.322834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:47.328858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:47.335443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:47.345885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2eaad-36e7-45ef-bcd7-59f5f649d814 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:47.364853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:47.365834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:47.366890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:47.367340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:47.368189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:47.383629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:47.384547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166c33c-0e78-4de2-939d-b5a52f3115e6 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:47.414127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:47.414677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:47.414961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:47.415243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] PATH_INFO: `/v3/projects/ecad2083ff8b46e0aa90603461f1f4ae` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:47.422627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecad2083ff8b46e0aa90603461f1f4ae)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:47.428433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:47.484939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 830/1657] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:47 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:47.489324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:47.543190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecad2083ff8b46e0aa90603461f1f4ae', 'request_id': 'req-9ab0189a-f6f8-4a1b-a6c8-49698df38054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:47.558243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecad2083ff8b46e0aa90603461f1f4ae', 'request_id': 'req-9ab0189a-f6f8-4a1b-a6c8-49698df38054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:47.574844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecad2083ff8b46e0aa90603461f1f4ae', 'request_id': 'req-9ab0189a-f6f8-4a1b-a6c8-49698df38054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:47.591728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] The token cache is being invalidate because project ecad2083ff8b46e0aa90603461f1f4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:47.592033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:47.594440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ab0189a-f6f8-4a1b-a6c8-49698df38054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:47.602333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 828/1658] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:47 2022] DELETE /identity/v3/projects/ecad2083ff8b46e0aa90603461f1f4ae => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:47.610466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ac73e-1314-447b-a136-819b3b21ae83 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:47.610717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ac73e-1314-447b-a136-819b3b21ae83 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:47.611002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ac73e-1314-447b-a136-819b3b21ae83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:47.655277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-614ac73e-1314-447b-a136-819b3b21ae83 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:47.656556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-614ac73e-1314-447b-a136-819b3b21ae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:47.665007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:47.750778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17e71-2db8-4da3-a953-8e08b85f7914 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:47.805416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 829/1659] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:47.827109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:47.831322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:47.832040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:47.890547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:47.891166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:47.891443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:47.891720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:47.892728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:47.902697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:47.933685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:47.934942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:47.969569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 830/1660] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:47.978399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:47.978577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 831/1661] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:47 2022] POST /identity/v3/users => generated 309 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:57:47.988153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:47.993115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:47.997799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e591-d31b-460f-bf12-68dc131fd1dc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.027587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.028223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.028503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.028774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.029474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:48.029757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.030550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6e034-9ceb-4609-980a-ad459f1f5d29 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.031380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.043986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.045082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.045437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.045727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.047203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.048904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.068944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 832/1662] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:48.070664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.099328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 831/1663] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:48.100792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.109706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadcb0e-ef67-4e14-981f-f612f01d1012 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.118688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.119623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.120075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.121859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] PATH_INFO: `/v3/projects/d65dd26a6f844f808e52a17444ca8f70/users/2bed590631fd4c888649b4f660d6d69f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.132887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c109b-46e4-4341-8ecc-b9d89182663a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.143195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:48.156555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65dd26a6f844f808e52a17444ca8f70, user_id=2bed590631fd4c888649b4f660d6d69f, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.158120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.159271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.160123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.160544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.160956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.161783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.163940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.185057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 833/1664] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:48 2022] PUT /identity/v3/projects/d65dd26a6f844f808e52a17444ca8f70/users/2bed590631fd4c888649b4f660d6d69f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:57:48.189134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.203383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 832/1665] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:48 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:48.207720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.331481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982401a2-c654-405d-9b2f-9f09b96a2e0f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.348362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.348362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.348647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.348791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.350004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.352173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e79f-72f5-444d-af4d-ed8fd4d2f1c3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.353390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.371173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.372297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.372297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.372709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.373487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.375206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.402883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 834/1666] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:48.404506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 833/1667] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:48 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:48.406645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.410426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.448991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf3d87-ae71-45c3-ac3a-a8df4c2c306d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.456195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7502c-e800-4b98-990c-5f7ea4335144 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.468328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.469016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.469562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.469985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.470111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] PATH_INFO: `/v3/projects/d65dd26a6f844f808e52a17444ca8f70/users/2bed590631fd4c888649b4f660d6d69f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.470752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.471108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.471453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.472177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.473027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65dd26a6f844f808e52a17444ca8f70, user_id=2bed590631fd4c888649b4f660d6d69f, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.474048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.485620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.486630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 834/1668] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:48.502452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.514928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 835/1669] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:48 2022] PUT /identity/v3/projects/d65dd26a6f844f808e52a17444ca8f70/users/2bed590631fd4c888649b4f660d6d69f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:57:48.534635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11cee2-42be-4302-93bd-c6afbd4e14ac admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.627780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:48.651672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594c9e9-3458-4c61-84c5-c65991193dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.652735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c9e9-3458-4c61-84c5-c65991193dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.653243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c9e9-3458-4c61-84c5-c65991193dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.653798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c9e9-3458-4c61-84c5-c65991193dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.661860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c9e9-3458-4c61-84c5-c65991193dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.664124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c9e9-3458-4c61-84c5-c65991193dc5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.690791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 835/1670] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:48.695843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:48.710574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c444a3-c016-4f99-9e2f-1f595f3c12f8 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:48.716284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:48.717248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.719388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.720107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] PATH_INFO: `/v3/projects/66ab63990df9425ea82704895ac4b52f/users/7cb09ef032f54322a32dd2b0e5812858/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.737690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab63990df9425ea82704895ac4b52f, user_id=7cb09ef032f54322a32dd2b0e5812858, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:48.740893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:48.759445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 836/1671] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:48 2022] PUT /identity/v3/projects/66ab63990df9425ea82704895ac4b52f/users/7cb09ef032f54322a32dd2b0e5812858/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:48.770265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:48.770790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:48.771279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:48.829763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] MFA Rules not processed for user `7cb09ef032f54322a32dd2b0e5812858`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:48.848869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:49.095803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:49.097754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:49.112288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 836/1672] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:49.366645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077710d-6e28-4491-b25d-f900d906ede0 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:49.383882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613af5e-80d4-45d9-9b7e-934b7b1fa722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:49.384520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613af5e-80d4-45d9-9b7e-934b7b1fa722 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:49.384808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613af5e-80d4-45d9-9b7e-934b7b1fa722 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:49.385083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613af5e-80d4-45d9-9b7e-934b7b1fa722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:49.407701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613af5e-80d4-45d9-9b7e-934b7b1fa722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:49.410349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613af5e-80d4-45d9-9b7e-934b7b1fa722 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:49.452279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 837/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:49.879879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:49.990304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081bb89-8d25-416f-b20d-237f56c201fe None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:50.005726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:50.006567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.006997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.007384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] PATH_INFO: `/v3/users/7cb09ef032f54322a32dd2b0e5812858` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.008723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb09ef032f54322a32dd2b0e5812858)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:50.010828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:50.112240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb09ef032f54322a32dd2b0e5812858'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.115767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb09ef032f54322a32dd2b0e5812858'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.129131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb09ef032f54322a32dd2b0e5812858'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.156389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb09ef032f54322a32dd2b0e5812858'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.162281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:50.189041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.190141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.190633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.191809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-16e53d8f-ee31-41f8-8b2b-0a5026d20144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb09ef032f54322a32dd2b0e5812858'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.205549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 837/1674] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:49 2022] DELETE /identity/v3/users/7cb09ef032f54322a32dd2b0e5812858 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:50.210388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.210687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.210965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.244242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:50.245534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.247505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] MFA Rules not processed for user `39d380ad69d9417a86f88f45341b68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:50.248895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.297229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:50.389989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 838/1675] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:50.406116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 838/1676] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:50.419671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:50.421144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.527351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:50.529290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.555601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab857a-8701-4e59-89df-3d572e3cacd3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:50.572325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:50.575203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.575495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.575777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] PATH_INFO: `/v3/users/02ff7594912f40adb14db63d5ea0e6a6` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.579450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ff7594912f40adb14db63d5ea0e6a6)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:50.581763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:50.611520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac101c-ee54-4de5-96c4-d4ae267579ef None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:50.627281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:50.627919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.628204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.628479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.643910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:50.650089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:50.671558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 839/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:50.692150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ff7594912f40adb14db63d5ea0e6a6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.715798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ff7594912f40adb14db63d5ea0e6a6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.718759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ff7594912f40adb14db63d5ea0e6a6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.724489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:50.727585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.748126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ff7594912f40adb14db63d5ea0e6a6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.766393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-359cba96-a5c0-432e-bf76-72697d47a2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ff7594912f40adb14db63d5ea0e6a6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.777361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 839/1678] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:50 2022] DELETE /identity/v3/users/02ff7594912f40adb14db63d5ea0e6a6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:50.778769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.779063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.779327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.846806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:50.848053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.852488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0f1f-8c01-496a-bc89-3b3eb6c526c2 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:50.960499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:51.008004 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:51.008676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:51.008961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:51.009234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:51.011734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:51.028388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 840/1679] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:51.118729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:51.120256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:51.132258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 840/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:51.150908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:51.153054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:51.187167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4a04-05a4-4f0e-8fd1-4703cb1a9480 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:51.194434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d4e3-a965-40d5-b767-218e1daaf405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:51.195218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d4e3-a965-40d5-b767-218e1daaf405 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:51.195505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d4e3-a965-40d5-b767-218e1daaf405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:51.195971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d4e3-a965-40d5-b767-218e1daaf405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:51.219572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3d4e3-a965-40d5-b767-218e1daaf405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:51.221034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3d4e3-a965-40d5-b767-218e1daaf405 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:51.250127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 841/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:53.617056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:53.620814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:53.669527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82e587-575a-4ce2-b832-726c5de04ac3 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:53.715849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:53.717925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:53.718456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:53.719398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] PATH_INFO: `/v3/projects/f228e2b03d3d418db3d6c678a3aaa3bc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:53.722174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f228e2b03d3d418db3d6c678a3aaa3bc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:53.724464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:53.836987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f228e2b03d3d418db3d6c678a3aaa3bc', 'request_id': 'req-a9912cd7-b84b-4bd9-9146-90742eb24fdd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:53.856692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f228e2b03d3d418db3d6c678a3aaa3bc', 'request_id': 'req-a9912cd7-b84b-4bd9-9146-90742eb24fdd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:53.872469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f228e2b03d3d418db3d6c678a3aaa3bc', 'request_id': 'req-a9912cd7-b84b-4bd9-9146-90742eb24fdd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:53.890388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:53.890875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:53.890950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:53.941585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] The token cache is being invalidate because project f228e2b03d3d418db3d6c678a3aaa3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:53.941884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:53.953128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a9912cd7-b84b-4bd9-9146-90742eb24fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:53.966487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 841/1682] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:53 2022] DELETE /identity/v3/projects/f228e2b03d3d418db3d6c678a3aaa3bc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:53.981137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a1c84-dbd5-47cf-b0fd-3ffef40ffe54 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:53.982629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a1c84-dbd5-47cf-b0fd-3ffef40ffe54 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:53.982916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a1c84-dbd5-47cf-b0fd-3ffef40ffe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.045507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] MFA Rules not processed for user `2bed590631fd4c888649b4f660d6d69f`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.047001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.054911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-096a1c84-dbd5-47cf-b0fd-3ffef40ffe54 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.056993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-096a1c84-dbd5-47cf-b0fd-3ffef40ffe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.067358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.188803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 842/1683] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.199206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007fcdf-8a19-47ee-9dd7-114cb48a041c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.199735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007fcdf-8a19-47ee-9dd7-114cb48a041c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.200265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 842/1684] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.201352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007fcdf-8a19-47ee-9dd7-114cb48a041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.205381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:54.207134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.235668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.236083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e674-19a9-4814-b3b0-51b76a9be327 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:54.255791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:54.257313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.257769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.258213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] PATH_INFO: `/v3/projects/66ab63990df9425ea82704895ac4b52f` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.260286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a007fcdf-8a19-47ee-9dd7-114cb48a041c None None] MFA Rules not processed for user `d67fb10a8a4a4dc188c3f4e50a277a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.261595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ab63990df9425ea82704895ac4b52f)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:54.261762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a007fcdf-8a19-47ee-9dd7-114cb48a041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.262954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: WARNING py.warnings [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:54.262954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: warnings.warn(msg) Aug 24 07:57:54.262954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: Aug 24 07:57:54.264482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:54.410344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ab63990df9425ea82704895ac4b52f', 'request_id': 'req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:54.430621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ab63990df9425ea82704895ac4b52f', 'request_id': 'req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:54.456256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ab63990df9425ea82704895ac4b52f', 'request_id': 'req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:54.457999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 843/1685] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.460599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bcfe1-72e5-4469-b8c0-6db87c04393d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.460981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bcfe1-72e5-4469-b8c0-6db87c04393d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.461339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bcfe1-72e5-4469-b8c0-6db87c04393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.476753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] The token cache is being invalidate because project 66ab63990df9425ea82704895ac4b52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:54.477079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:54.477745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e2b4b9e3-7008-4b31-9d4a-cb818d7389eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:54.479549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 843/1686] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:54 2022] DELETE /identity/v3/projects/66ab63990df9425ea82704895ac4b52f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:54.480896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.481174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.485602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.493031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-626bcfe1-72e5-4469-b8c0-6db87c04393d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.494577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-626bcfe1-72e5-4469-b8c0-6db87c04393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.520806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] MFA Rules not processed for user `d67fb10a8a4a4dc188c3f4e50a277a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.522329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.626144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 844/1687] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.627743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.628357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.629584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.647505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 844/1688] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.654927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:54.680653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e56af0-ed59-4ff0-86de-0e6c8816add4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:54.682311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.687811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.692645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:54.695283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.695750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.696841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.697658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:54.699077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:54.703162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900cd25-1c35-406e-9258-c486d16b35fe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:54.708304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 845/1689] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.709460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:54.710960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.739641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 845/1690] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:54.739979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251db46-181e-4b78-a389-285cd068d653 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.740177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251db46-181e-4b78-a389-285cd068d653 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.740456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251db46-181e-4b78-a389-285cd068d653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.793140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3251db46-181e-4b78-a389-285cd068d653 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:54.796776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3251db46-181e-4b78-a389-285cd068d653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.809099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 846/1691] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:54.809963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251db46-181e-4b78-a389-285cd068d653 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:54.824522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251db46-181e-4b78-a389-285cd068d653 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:54.833457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:54.834186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.834505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.834817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.835511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:54.837770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:54.857685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.875342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39503587-4a80-471b-b889-6ff9afbb7020 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:54.882284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:54.883025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:54.883314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:54.883650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:54.886113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:54.889879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 847/1692] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:54.889879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:54.901431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:54.903217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:54.915497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 846/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:54.916305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:54.930148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51985aba-2d55-47cc-9494-4c8557cfa768 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:54.951326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.995246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966171-24a5-445f-8678-52c83ed13bfe admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.003104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.003922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.004254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.004526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.005177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:55.005612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.007242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.026357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 848/1694] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:55.027274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.040715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c50ef-d1eb-43c6-81b0-caffd9c5c244 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.048003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174ef5f-a8b7-4c34-91d5-0a1f9c44d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.048739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174ef5f-a8b7-4c34-91d5-0a1f9c44d607 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.049029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174ef5f-a8b7-4c34-91d5-0a1f9c44d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.049828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174ef5f-a8b7-4c34-91d5-0a1f9c44d607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.050354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174ef5f-a8b7-4c34-91d5-0a1f9c44d607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.052670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174ef5f-a8b7-4c34-91d5-0a1f9c44d607 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.103804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956deb93-3bca-4a6d-9001-15635ae7bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.104442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956deb93-3bca-4a6d-9001-15635ae7bcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.106577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956deb93-3bca-4a6d-9001-15635ae7bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.106965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956deb93-3bca-4a6d-9001-15635ae7bcb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.107501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956deb93-3bca-4a6d-9001-15635ae7bcb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.111584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956deb93-3bca-4a6d-9001-15635ae7bcb4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.186278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 849/1695] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:55 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:55.188609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.189131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.190239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.213593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 847/1696] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:54 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:55.216786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.217110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.218353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.266778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] MFA Rules not processed for user `e8e5a0df4ec54ab495a007f8804f23b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:55.269585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:55.300440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] MFA Rules not processed for user `412a8703f2d44e95ab52d655316404bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:55.301719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:55.396031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 850/1697] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:55.397019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.460480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 848/1698] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:55.461439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.541757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:55.554360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a7db-3ac9-4f70-a1bb-64d673e1b086 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.555990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2353e-c2c6-4489-95f1-969c26ee6bd8 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.566419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.567302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.569792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.570327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.570775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.571262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.571867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.572585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.572959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.573743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.576658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.577700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.619333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 849/1699] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:55.626388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.630176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:55.652379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 851/1700] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:55 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:55.653684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.682968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59e9a-c514-437b-9c6b-08bda73b2a58 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.699630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.709462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.716889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.718357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.720417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.725106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.750013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:55.759461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 852/1701] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:55.762646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.789650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edb4cd-ea0e-4929-b2c6-938af0bd003f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.797741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.798856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.799702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.800151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.801574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.803977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.829880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 853/1702] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:55.832542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.848169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6341d-92a3-480a-b43c-75a1581d8a13 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.858859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b0ce-d1c6-4d9d-b7df-8f81559ffa49 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.859848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82b743-e448-4443-b26c-6cbeefca7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.860934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82b743-e448-4443-b26c-6cbeefca7c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.861539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82b743-e448-4443-b26c-6cbeefca7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.861992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82b743-e448-4443-b26c-6cbeefca7c89 admin admin] PATH_INFO: `/v3/projects/cb71171097fa4ea2bf6a2e51b5b765b6/users/abf1924c764c480db101f640be47f976/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.871765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:55.872507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.872874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.873151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:55.890726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.892262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.895206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82b743-e448-4443-b26c-6cbeefca7c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb71171097fa4ea2bf6a2e51b5b765b6, user_id=abf1924c764c480db101f640be47f976, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:55.904795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82b743-e448-4443-b26c-6cbeefca7c89 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:55.915999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 850/1703] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:55.916973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:55.935529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 854/1704] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:55 2022] PUT /identity/v3/projects/cb71171097fa4ea2bf6a2e51b5b765b6/users/abf1924c764c480db101f640be47f976/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:55.946798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aada814-c7ee-4d0e-969f-a29e162bf567 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:55.948628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:55.954113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:55.954461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.032319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] MFA Rules not processed for user `abf1924c764c480db101f640be47f976`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:56.034092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:56.124218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:56.125912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.125912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.125912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.126152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:56.127625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:56.163464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 851/1705] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:56.164498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:56.195656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 855/1706] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:56.195656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:56.219120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551048-2204-4046-b0c4-f56431ea7c96 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:56.243706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:56.244395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.244672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.244945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] PATH_INFO: `/v3/projects/0b8d846ce005467682f612a6fc06cbf5/users/58dc21ffa469412790efa20f376c2b18/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.271547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8d846ce005467682f612a6fc06cbf5, user_id=58dc21ffa469412790efa20f376c2b18, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:56.274304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:56.312050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 856/1707] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:56 2022] PUT /identity/v3/projects/0b8d846ce005467682f612a6fc06cbf5/users/58dc21ffa469412790efa20f376c2b18/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:56.312889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:56.363842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe8809-aadd-4919-a1e9-bf3bb749ba66 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:56.470758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:56.499947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095165c-7629-49c4-a5bd-d06861461f7d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:56.508398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae155f-865b-4094-a1a4-a5781297e205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:56.509169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e874a4f-d863-40f9-b1fc-199071a62141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:56.509844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874a4f-d863-40f9-b1fc-199071a62141 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.510007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae155f-865b-4094-a1a4-a5781297e205 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.510126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874a4f-d863-40f9-b1fc-199071a62141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.510384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874a4f-d863-40f9-b1fc-199071a62141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.510866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae155f-865b-4094-a1a4-a5781297e205 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.511014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874a4f-d863-40f9-b1fc-199071a62141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:56.512814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae155f-865b-4094-a1a4-a5781297e205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.512939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874a4f-d863-40f9-b1fc-199071a62141 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:56.545635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:56.606340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 857/1708] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:56 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:56.607652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eec0c-68db-43fb-8808-1c6d9b965762 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.607939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eec0c-68db-43fb-8808-1c6d9b965762 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.608215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eec0c-68db-43fb-8808-1c6d9b965762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.641778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae155f-865b-4094-a1a4-a5781297e205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:56.644173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae155f-865b-4094-a1a4-a5781297e205 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:56.659741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 852/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:56.666588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd9070-699d-4772-80fa-62d6ebcf0080 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.666887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd9070-699d-4772-80fa-62d6ebcf0080 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.667287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd9070-699d-4772-80fa-62d6ebcf0080 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.670160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 853/1710] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 07:57:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:56.671330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd9070-699d-4772-80fa-62d6ebcf0080 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:56.702063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ad3eec0c-68db-43fb-8808-1c6d9b965762 None None] MFA Rules not processed for user `58dc21ffa469412790efa20f376c2b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:56.703413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ad3eec0c-68db-43fb-8808-1c6d9b965762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:56.892573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 858/1711] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:56.892573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.892573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.892573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.904903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd9070-699d-4772-80fa-62d6ebcf0080 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:56.916852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:56.917503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:56.917806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:56.918066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:56.919331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:56.925672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:56.971437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 854/1712] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:56 2022] POST /identity/v3/users => generated 295 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:56.972603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:56.996587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752bdfd-f2ce-4884-9a07-8c6f9c449567 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.004119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.005209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.005717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.006191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.006291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:57.007734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.008027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:57.010536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.096760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 855/1713] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:56 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:57.097851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.182495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 859/1714] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 07:57:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:57.189410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.206200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:57.213894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf013-6dab-4877-a561-59aa6bfd9dad admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.221592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b509b6-75d0-4831-b720-a5f7d0514962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.222364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b509b6-75d0-4831-b720-a5f7d0514962 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.222718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b509b6-75d0-4831-b720-a5f7d0514962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.223067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b509b6-75d0-4831-b720-a5f7d0514962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.223912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b509b6-75d0-4831-b720-a5f7d0514962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.226255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b509b6-75d0-4831-b720-a5f7d0514962 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.233210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ba38e-a945-4178-9f99-22bb27342254 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.238612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 856/1715] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:57.240067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74871c61-a6c1-4fbf-aa7f-26cecc9e4c80 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.240430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74871c61-a6c1-4fbf-aa7f-26cecc9e4c80 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.240879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74871c61-a6c1-4fbf-aa7f-26cecc9e4c80 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.244663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 857/1716] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:57.245545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74871c61-a6c1-4fbf-aa7f-26cecc9e4c80 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.252113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.252769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.253005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.253288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.253932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.255878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.262406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74871c61-a6c1-4fbf-aa7f-26cecc9e4c80 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.268857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.270025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.270384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.270781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] PATH_INFO: `/v3/projects/be7c4f07cc284498a7aa71a1358db679/users/a6b421ba778246b5a805cf9925312c9d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.293958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7c4f07cc284498a7aa71a1358db679, user_id=a6b421ba778246b5a805cf9925312c9d, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.297350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.323516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 858/1717] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:57 2022] PUT /identity/v3/projects/be7c4f07cc284498a7aa71a1358db679/users/a6b421ba778246b5a805cf9925312c9d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:57.324897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.327525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:57.332300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 860/1718] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:57 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:57.332300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.368577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004589f-4629-4391-858c-48ebdc591106 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.411415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93624b-5672-4e0b-944a-a0a14f1bde43 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.417873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.419626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.420278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.420763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.434366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.437111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.451260 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 859/1719] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:57.453146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.546276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:57.569125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89c1e-1a96-420f-bf5d-d7532e7d016a service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.572255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.572899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.573184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.573486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.574134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.575447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.575752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.576177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.576529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.576940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.578518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.580739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.601920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 860/1720] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:57.607334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.619534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 861/1721] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:57.620145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04300e-fd80-420e-ba84-a13a3f0aed93 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.626298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.628590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.629343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.630621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.630858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] PATH_INFO: `/v3/projects/6026519c62634057930c55d1db23feba/users/23441b895eec4464a99c5a7f4c8b645b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.654031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be8957-270e-4821-a04b-aaf34f70938c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:57.660957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6026519c62634057930c55d1db23feba, user_id=23441b895eec4464a99c5a7f4c8b645b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.669026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.673507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461319b-c75d-4e04-a97e-bde078b7192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:57.674199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461319b-c75d-4e04-a97e-bde078b7192b admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.674481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461319b-c75d-4e04-a97e-bde078b7192b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.674756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461319b-c75d-4e04-a97e-bde078b7192b admin admin] PATH_INFO: `/v3/projects/be7c4f07cc284498a7aa71a1358db679/users/a6b421ba778246b5a805cf9925312c9d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.686172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461319b-c75d-4e04-a97e-bde078b7192b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7c4f07cc284498a7aa71a1358db679, user_id=a6b421ba778246b5a805cf9925312c9d, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:57.688872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461319b-c75d-4e04-a97e-bde078b7192b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:57.707554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 861/1722] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:57 2022] PUT /identity/v3/projects/6026519c62634057930c55d1db23feba/users/23441b895eec4464a99c5a7f4c8b645b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:57.714900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:57.731155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 862/1723] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:57 2022] PUT /identity/v3/projects/be7c4f07cc284498a7aa71a1358db679/users/a6b421ba778246b5a805cf9925312c9d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:57:57.732856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127290c-7ab8-4403-9765-d25e93697031 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:57.733144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127290c-7ab8-4403-9765-d25e93697031 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:57.733446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127290c-7ab8-4403-9765-d25e93697031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:57.821393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b127290c-7ab8-4403-9765-d25e93697031 None None] MFA Rules not processed for user `a6b421ba778246b5a805cf9925312c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:57.822656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b127290c-7ab8-4403-9765-d25e93697031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:57.876037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:57.935604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab96be1-84e3-4812-b327-32270c957f3e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:58.021539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 863/1724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:58.023390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.023679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.024513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.067474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003287f-74f0-4ceb-bb45-c36e9d2ae541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:58.068123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003287f-74f0-4ceb-bb45-c36e9d2ae541 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.068456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003287f-74f0-4ceb-bb45-c36e9d2ae541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.069582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003287f-74f0-4ceb-bb45-c36e9d2ae541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.070141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003287f-74f0-4ceb-bb45-c36e9d2ae541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:58.072216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003287f-74f0-4ceb-bb45-c36e9d2ae541 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:58.091394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 862/1725] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:58.093204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.093732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.093825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.106248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] MFA Rules not processed for user `85637ddc957645339d4f92a909442640`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:58.107473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:58.142456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:58.144917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:58.324952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 864/1726] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:58.328289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:58.335388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:58.374410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 863/1727] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:57:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:58.375286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:58.414495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edbc7a-44bc-4568-a9f2-5335c79ab341 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:58.422443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7374901-3f5b-45b3-8595-015ec7ff255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:58.424036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7374901-3f5b-45b3-8595-015ec7ff255a admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.424542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7374901-3f5b-45b3-8595-015ec7ff255a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.425044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7374901-3f5b-45b3-8595-015ec7ff255a admin admin] PATH_INFO: `/v3/projects/6026519c62634057930c55d1db23feba/users/23441b895eec4464a99c5a7f4c8b645b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.427683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7374901-3f5b-45b3-8595-015ec7ff255a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6026519c62634057930c55d1db23feba, user_id=23441b895eec4464a99c5a7f4c8b645b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:58.431512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7374901-3f5b-45b3-8595-015ec7ff255a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:58.477343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 864/1728] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:58 2022] PUT /identity/v3/projects/6026519c62634057930c55d1db23feba/users/23441b895eec4464a99c5a7f4c8b645b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:58.477343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a58816-aa78-4eb9-b962-5df15d37c5e9 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.477343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a58816-aa78-4eb9-b962-5df15d37c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.477343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a58816-aa78-4eb9-b962-5df15d37c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.494110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215577b-f8cd-4a2e-8579-6ecf4606c1c8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:58.515837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:58.533463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d4a58816-aa78-4eb9-b962-5df15d37c5e9 None None] MFA Rules not processed for user `85637ddc957645339d4f92a909442640`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:58.534941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d4a58816-aa78-4eb9-b962-5df15d37c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:58.656993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 865/1729] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:58.661900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01274248-73b0-43fc-8ac0-15fd034e68c1 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.662463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01274248-73b0-43fc-8ac0-15fd034e68c1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.662463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01274248-73b0-43fc-8ac0-15fd034e68c1 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.672621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 866/1730] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 24 07:57:58 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:58.674291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe0f1-04d9-44dc-b30c-d27b05c9419a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.674673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe0f1-04d9-44dc-b30c-d27b05c9419a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.675024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe0f1-04d9-44dc-b30c-d27b05c9419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.684722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:58.685423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.685708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.685982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.772616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:58.774802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-34ebe0f1-04d9-44dc-b30c-d27b05c9419a None None] MFA Rules not processed for user `23441b895eec4464a99c5a7f4c8b645b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:58.776533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-34ebe0f1-04d9-44dc-b30c-d27b05c9419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:58.854385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:58.856488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:58.883505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 865/1731] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:58.884202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:58.889434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 867/1732] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:58.890896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:58.891192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:58.891842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:58.940371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:58.941902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.108094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e6529-5d27-41fa-9faa-5ced07745137 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:59.135705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344864-b880-4fcd-b56b-9d8a538fde38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:59.136499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344864-b880-4fcd-b56b-9d8a538fde38 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.136699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344864-b880-4fcd-b56b-9d8a538fde38 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.136950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344864-b880-4fcd-b56b-9d8a538fde38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.162003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 868/1733] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 24 07:57:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:59.173550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:59.175641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.185689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344864-b880-4fcd-b56b-9d8a538fde38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:59.196359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344864-b880-4fcd-b56b-9d8a538fde38 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:59.201445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec829-4596-4c52-9cd9-958363075e2e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:59.226702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:59.227626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.228055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.228477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.234202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.242372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 866/1734] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:59.243850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba5e1-c2a9-4824-96eb-5fe62d8ebe84 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.244143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba5e1-c2a9-4824-96eb-5fe62d8ebe84 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.244428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba5e1-c2a9-4824-96eb-5fe62d8ebe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.274099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:59.276402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:59.300334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 869/1735] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:59.301515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:59.310599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.315566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-653ba5e1-c2a9-4824-96eb-5fe62d8ebe84 None None] MFA Rules not processed for user `d67fb10a8a4a4dc188c3f4e50a277a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:59.316801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-653ba5e1-c2a9-4824-96eb-5fe62d8ebe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.335233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479c3ae-5f3e-4b09-baa8-9466832174a0 service placement] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:59.352256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:59.352998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.353367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.353888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.408769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:59.418067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:59.447062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 870/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:59.447747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:59.490573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:59.496970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ddee9-1553-4add-a83b-81396889ea10 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:59.515334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:59.515879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.516168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.516445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.521625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 867/1737] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:57:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:59.531687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:59.533727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:59.546348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 871/1738] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:00.316847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:00.319620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:00.320211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:00.350006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] MFA Rules not processed for user `39d380ad69d9417a86f88f45341b68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:00.351994 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:00.526461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 868/1739] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:00.692418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:00.824393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:00.834278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe7a9d-c984-404b-9d81-2515ede973b4 service placement] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:00.844852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:00.845795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:00.850106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:00.851536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] PATH_INFO: `/v3/users/58dc21ffa469412790efa20f376c2b18` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:00.858831 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dc21ffa469412790efa20f376c2b18)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:00.868424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:00.925389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:00.927221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:00.964922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8a1fc-d02e-415e-a577-14d3c9b3bb44 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:00.973183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:00.974551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:00.975073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:00.975584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] PATH_INFO: `/v3/users/703e8f7de46341bb92ebc938ba45cda6` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:00.977399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=703e8f7de46341bb92ebc938ba45cda6)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:00.979782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:00.992873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dc21ffa469412790efa20f376c2b18'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:00.993946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dc21ffa469412790efa20f376c2b18'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.023932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dc21ffa469412790efa20f376c2b18'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.048253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dc21ffa469412790efa20f376c2b18'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.059174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1807f250-ceb9-4580-b877-4c9d098b270a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dc21ffa469412790efa20f376c2b18'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.067176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 872/1740] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:00 2022] DELETE /identity/v3/users/58dc21ffa469412790efa20f376c2b18 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:01.067742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703e8f7de46341bb92ebc938ba45cda6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.069324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af18a-80ac-423c-8e09-0cb9d9d1fbaa None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:01.069600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af18a-80ac-423c-8e09-0cb9d9d1fbaa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:01.070158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af18a-80ac-423c-8e09-0cb9d9d1fbaa None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:01.071621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 873/1741] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 07:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:58:01.076951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:01.077303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:01.077531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:01.091014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703e8f7de46341bb92ebc938ba45cda6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.092023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703e8f7de46341bb92ebc938ba45cda6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.109098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:01.110440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:01.132027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703e8f7de46341bb92ebc938ba45cda6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.153058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-67ad18ad-66c2-4b35-a261-6416ad47cc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703e8f7de46341bb92ebc938ba45cda6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:01.181465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 869/1742] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:00 2022] DELETE /identity/v3/users/703e8f7de46341bb92ebc938ba45cda6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:01.193723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:01.195382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:01.195672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:01.214455 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 874/1743] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:01.246431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:01.252335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:01.254265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:01.255469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:01.376290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 870/1744] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 07:58:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:01.385294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65bde1-70e2-4bf4-8f15-23f52b23bc51 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:01.386347 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:01.390373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:01.394636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:01.395273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:01.395606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:01.397413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:01.463670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:01.485954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:01.569752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc921-2648-4d7b-9d99-5bf6546bfaa7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:01.574519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:01.575812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:01.576095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:01.576367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:01.578320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:01.581899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:01.587280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:01.621992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 875/1745] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:01.623910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:01.630738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:01.666836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe582ac-09e8-4fed-bc3f-230cb2d017fc service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:01.679521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:01.680404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:01.680761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:01.681106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:01.688470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:01.690299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:01.697559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:01.699287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:01.704445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 871/1746] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:01.724911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 876/1747] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:02.729277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:02.731291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:02.765244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0d92-bdd1-4639-8876-6220e3b4bc3f service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:02.796588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:02.798580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:02.801037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:02.801882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:02.802036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:02.802312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] PATH_INFO: `/v3/projects/0b8d846ce005467682f612a6fc06cbf5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:02.804318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8d846ce005467682f612a6fc06cbf5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:02.811880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:02.826533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129cf20-f30b-4136-9156-9bc12cc69662 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:02.849599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:02.850326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:02.850607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:02.851336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] PATH_INFO: `/v3/projects/9d6289e5f4784aedabc8bc3a90327378` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:02.853548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6289e5f4784aedabc8bc3a90327378)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:02.857385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:02.950300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8d846ce005467682f612a6fc06cbf5', 'request_id': 'req-19c4d5f0-14ff-413d-8568-f8e5e857dd53'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:02.957550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8d846ce005467682f612a6fc06cbf5', 'request_id': 'req-19c4d5f0-14ff-413d-8568-f8e5e857dd53'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:02.967667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8d846ce005467682f612a6fc06cbf5', 'request_id': 'req-19c4d5f0-14ff-413d-8568-f8e5e857dd53'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:02.980835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] The token cache is being invalidate because project 0b8d846ce005467682f612a6fc06cbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:02.981127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:02.981885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-19c4d5f0-14ff-413d-8568-f8e5e857dd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:02.984067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 872/1748] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:02 2022] DELETE /identity/v3/projects/0b8d846ce005467682f612a6fc06cbf5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:02.986583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:02.986875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:02.987148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:03.003918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6289e5f4784aedabc8bc3a90327378', 'request_id': 'req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.020855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6289e5f4784aedabc8bc3a90327378', 'request_id': 'req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.042136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6289e5f4784aedabc8bc3a90327378', 'request_id': 'req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.060469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:03.061828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] The token cache is being invalidate because project 9d6289e5f4784aedabc8bc3a90327378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:03.062163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:03.062305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.062979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.065027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 877/1749] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:02 2022] DELETE /identity/v3/projects/9d6289e5f4784aedabc8bc3a90327378 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:03.065944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:03.076129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:03.157317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:03.358325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 873/1750] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 07:58:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:03.359583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:03.363533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:03.374736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415af4b-d882-4ef9-91cd-5a6f09dbfde4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:03.395560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:03.396944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:03.397196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:03.403536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] PATH_INFO: `/v3/users/23441b895eec4464a99c5a7f4c8b645b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:03.406827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23441b895eec4464a99c5a7f4c8b645b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:03.414370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:03.423409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e6d11-4eb7-4304-ac0c-365c201d79ae None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:03.452490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:03.453756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:03.454039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:03.454314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] PATH_INFO: `/v3/users/2bed590631fd4c888649b4f660d6d69f` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:03.460558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bed590631fd4c888649b4f660d6d69f)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:03.467468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:03.585813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:03.617347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23441b895eec4464a99c5a7f4c8b645b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.618215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23441b895eec4464a99c5a7f4c8b645b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.649875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23441b895eec4464a99c5a7f4c8b645b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.678817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bed590631fd4c888649b4f660d6d69f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.699993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bed590631fd4c888649b4f660d6d69f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.700906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23441b895eec4464a99c5a7f4c8b645b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.703165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bed590631fd4c888649b4f660d6d69f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.721425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7288cf4d-8828-490f-90cc-5d7f2d37fce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23441b895eec4464a99c5a7f4c8b645b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.739815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 878/1751] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:03 2022] DELETE /identity/v3/users/23441b895eec4464a99c5a7f4c8b645b => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:03.743055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa8f2-c94f-401f-b4db-6390325e3233 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:03.743343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa8f2-c94f-401f-b4db-6390325e3233 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:03.743622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa8f2-c94f-401f-b4db-6390325e3233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:03.747790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bed590631fd4c888649b4f660d6d69f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.770179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bed590631fd4c888649b4f660d6d69f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:03.796208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 874/1752] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:03 2022] DELETE /identity/v3/users/2bed590631fd4c888649b4f660d6d69f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:03.807087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4adfa8f2-c94f-401f-b4db-6390325e3233 None None] MFA Rules not processed for user `e8e5a0df4ec54ab495a007f8804f23b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:03.811407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4adfa8f2-c94f-401f-b4db-6390325e3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:03.842165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:03.844074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:03.957311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 879/1753] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:03.984635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:03.985110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:03.985411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:04.086719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] MFA Rules not processed for user `412a8703f2d44e95ab52d655316404bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:04.103162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:04.143331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7c46-6a20-4820-8062-49f26bfa6e63 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:04.173871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:04.174700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:04.175041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:04.176424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:04.184154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:04.244034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:04.338083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 880/1754] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:04.363250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:04.365136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56ab1d-4711-4c7c-a5aa-71e1aa6772b2 service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:04.401397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 875/1755] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 07:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:58:04.547193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:04.549185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:04.716242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a8c65-6b6b-49a1-ba7d-3982b6df3ff3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:04.721517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:04.722394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:04.722509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:04.722812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] PATH_INFO: `/v3/projects/d65dd26a6f844f808e52a17444ca8f70` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:04.723968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65dd26a6f844f808e52a17444ca8f70)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:04.727069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:04.734839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:04.829794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65dd26a6f844f808e52a17444ca8f70', 'request_id': 'req-aa252535-55cb-430c-b918-dddfd9798982'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:04.881700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65dd26a6f844f808e52a17444ca8f70', 'request_id': 'req-aa252535-55cb-430c-b918-dddfd9798982'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:04.913370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65dd26a6f844f808e52a17444ca8f70', 'request_id': 'req-aa252535-55cb-430c-b918-dddfd9798982'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:04.939606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] The token cache is being invalidate because project d65dd26a6f844f808e52a17444ca8f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:04.939886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:04.940952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa252535-55cb-430c-b918-dddfd9798982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:04.947222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 881/1756] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:04 2022] DELETE /identity/v3/projects/d65dd26a6f844f808e52a17444ca8f70 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:04.953942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:04.955043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:04.956086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:04.996304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:04.998985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:05.205445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 876/1757] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:05.207345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:05.207772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:05.208129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:05.259745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:05.261416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:05.273388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 882/1758] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:05.279689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:05.295686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26ff29-7967-4500-a6fb-287a3acf229e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:05.301682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:05.302443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:05.302833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:05.303739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:05.304506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:05.304933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:05.328501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:05.362025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 877/1759] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:05.363740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:05.376986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a535e-d8f1-4758-8e34-ffbf5af65125 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:05.413176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:05.418462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:05.422494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:05.425941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:05.428804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:05.435495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:05.515143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 883/1760] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:05 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:05.519425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:05.537203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77145894-05f6-40b5-9205-04e6b347647c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:05.743161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:05.744224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:05.745725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:05.746223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:05.747461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:05.757209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:05.778281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:05.780528 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:05.806688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799bf16-ae31-45b4-a4f3-e575eaf124c9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:05.822229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 878/1761] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:05 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:05.826112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19818938-0705-434c-8755-240e077f6241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:05.827975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:05.828604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19818938-0705-434c-8755-240e077f6241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:05.829208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19818938-0705-434c-8755-240e077f6241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:05.830862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19818938-0705-434c-8755-240e077f6241 admin admin] PATH_INFO: `/v3/projects/6026519c62634057930c55d1db23feba` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:05.833730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19818938-0705-434c-8755-240e077f6241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6026519c62634057930c55d1db23feba)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:05.841662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19818938-0705-434c-8755-240e077f6241 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:05.864421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddad5f-8c86-4747-a8cc-cbc675979e4d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:05.886019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:05.887136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:05.887892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:05.889210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:05.890819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:05.897449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:05.937156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 879/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:05.938210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:05.964141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73c4b-21a5-43a3-a889-2271c04ddbda admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:05.997295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-19818938-0705-434c-8755-240e077f6241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6026519c62634057930c55d1db23feba', 'request_id': 'req-19818938-0705-434c-8755-240e077f6241'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:06.008999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-19818938-0705-434c-8755-240e077f6241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6026519c62634057930c55d1db23feba', 'request_id': 'req-19818938-0705-434c-8755-240e077f6241'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:06.024129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-19818938-0705-434c-8755-240e077f6241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6026519c62634057930c55d1db23feba', 'request_id': 'req-19818938-0705-434c-8755-240e077f6241'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:06.068277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:06.078260 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-19818938-0705-434c-8755-240e077f6241 admin admin] The token cache is being invalidate because project 6026519c62634057930c55d1db23feba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:06.078852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-19818938-0705-434c-8755-240e077f6241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:06.080376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-19818938-0705-434c-8755-240e077f6241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:06.084243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 884/1763] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:05 2022] DELETE /identity/v3/projects/6026519c62634057930c55d1db23feba => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:06.089794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbad19e-79c8-4ce3-a254-fdb0d7868cf9 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.090496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbad19e-79c8-4ce3-a254-fdb0d7868cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.091114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbad19e-79c8-4ce3-a254-fdb0d7868cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.124618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.125532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.125825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.126153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.127112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.129946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.150373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 880/1764] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:06.156628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.159637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:06.178905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2cbad19e-79c8-4ce3-a254-fdb0d7868cf9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:06.180148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2cbad19e-79c8-4ce3-a254-fdb0d7868cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:06.192874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 885/1765] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:06.198076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5740d-5082-443c-809f-4f1a65568198 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.201541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.201829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.202257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.232374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d99e-4d5a-4374-b644-593b6edf9bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.238796 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d99e-4d5a-4374-b644-593b6edf9bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.239346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d99e-4d5a-4374-b644-593b6edf9bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.239767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d99e-4d5a-4374-b644-593b6edf9bae admin admin] PATH_INFO: `/v3/projects/e782a3b0754e4a08ac624783f94c7684/users/0f5f3a8cfff441bf9f671f53f580a3d9/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.269502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:06.278891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:06.289242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2d99e-4d5a-4374-b644-593b6edf9bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e782a3b0754e4a08ac624783f94c7684, user_id=0f5f3a8cfff441bf9f671f53f580a3d9, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.295362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2d99e-4d5a-4374-b644-593b6edf9bae admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.295553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 886/1766] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:06.300005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.317647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79d57d-5bce-4b66-8a14-46f375052e9b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.335122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 881/1767] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:06 2022] PUT /identity/v3/projects/e782a3b0754e4a08ac624783f94c7684/users/0f5f3a8cfff441bf9f671f53f580a3d9/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:06.342619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.342902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.343213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.403886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:06.404703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] MFA Rules not processed for user `0f5f3a8cfff441bf9f671f53f580a3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:06.406965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:06.458823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.460030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.460309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.460578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.461229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:06.461714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.469687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.488019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 887/1768] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:06.492116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.517111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169989ee-8a2b-47c6-815f-a85a02c66808 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.542419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 882/1769] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:06.546684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.554284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.558140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.558677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b0a4-7cfc-4ae7-9111-24f51dc3d5d2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.564990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.566332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.567520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.568152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.568693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.568984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.569276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.570249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.572058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.578520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.612374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 883/1770] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:06.617504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.637852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 888/1771] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:06.639804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.791777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e45741-246c-4294-9d88-47757342a122 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.828315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:06.844354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3033-22a5-4e75-b6bc-28d03096f3ce admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.858348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.861006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.861431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.864691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.866085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.870729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.922836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 889/1772] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:06.922836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:06.924797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:06.953091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.955135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.956201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.957053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.958976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7018-3e2c-47bf-b1c1-fd04704c705f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:06.959863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.965795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:06.972282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:06.975500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:06.976251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:06.977481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] PATH_INFO: `/v3/users/abf1924c764c480db101f640be47f976` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:06.981775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf1924c764c480db101f640be47f976)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:06.985977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.014894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 884/1773] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:06 2022] POST /identity/v3/users => generated 298 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:07.016970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.043525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa342d-4a96-4cc4-b710-e574eaa641d6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:07.058481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:07.060248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.061107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.061610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.063466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:07.065747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.106114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 885/1774] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:07.106910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.108936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf1924c764c480db101f640be47f976'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:07.110230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf1924c764c480db101f640be47f976'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:07.124291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf1924c764c480db101f640be47f976'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:07.147442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367047d-418f-497b-ab5f-ca3ee4b33076 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:07.157899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf1924c764c480db101f640be47f976'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:07.158601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:07.159494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.159632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.159881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.160602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:07.163147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.177189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf1924c764c480db101f640be47f976'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:07.190207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 886/1775] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:07.191092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.192345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 890/1776] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:06 2022] DELETE /identity/v3/users/abf1924c764c480db101f640be47f976 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:07.194112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.195926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:07.206601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:07.220834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:07.230102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c310-ac29-43c8-acc7-2f3ebe9f5522 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:07.329403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42055-120b-4ae9-98db-79e9e80d24e4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:07.339052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:07.339826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.340839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.341375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] PATH_INFO: `/v3/projects/cb208d63188f4557a20adc5caad79a9a/users/b461dd20a837419fb1a23f69aa60d16b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.355116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745893-2379-4d84-831b-5cc2cd7b4ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:07.356051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745893-2379-4d84-831b-5cc2cd7b4ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.356451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745893-2379-4d84-831b-5cc2cd7b4ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.358293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745893-2379-4d84-831b-5cc2cd7b4ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.360162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e745893-2379-4d84-831b-5cc2cd7b4ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:07.365324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e745893-2379-4d84-831b-5cc2cd7b4ce9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.378936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb208d63188f4557a20adc5caad79a9a, user_id=b461dd20a837419fb1a23f69aa60d16b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:07.382499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.390773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 887/1777] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:07.394261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e4e50-82fb-4e7c-af14-a3e956035abf None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.395421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e4e50-82fb-4e7c-af14-a3e956035abf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.395421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e4e50-82fb-4e7c-af14-a3e956035abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.420566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 891/1778] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:07 2022] PUT /identity/v3/projects/cb208d63188f4557a20adc5caad79a9a/users/b461dd20a837419fb1a23f69aa60d16b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:07.421374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.451091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ac3e4e50-82fb-4e7c-af14-a3e956035abf None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:07.452762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ac3e4e50-82fb-4e7c-af14-a3e956035abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:07.578372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ef22-07f7-4a38-8d25-da6dc67150da admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:07.602172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:07.603313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.603931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.604352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] PATH_INFO: `/v3/projects/3a5a63a714044462a52d7de331b80514/users/7db6d1a133f0427688b2ec1cf9f56a52/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.635025 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5a63a714044462a52d7de331b80514, user_id=7db6d1a133f0427688b2ec1cf9f56a52, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:07.639978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.678966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 892/1779] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:07 2022] PUT /identity/v3/projects/3a5a63a714044462a52d7de331b80514/users/7db6d1a133f0427688b2ec1cf9f56a52/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:07.681933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.685022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 888/1780] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:07.686695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.687093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.688356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.742057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] MFA Rules not processed for user `7db6d1a133f0427688b2ec1cf9f56a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:07.744537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:07.750798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:07.879825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90eebf-11f8-486d-8881-5a85e3214878 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:07.892817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:07.897781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:07.898353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:07.899525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:07.900488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:07.904494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:07.946096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 893/1781] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:07.946096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.956788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:07.976844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 889/1782] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:07.976844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:07.990190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:08.005839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41256-d27c-49db-9405-8f7fee597cd4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:08.024103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:08.027546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:08.027546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:08.029642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] PATH_INFO: `/v3/projects/cb208d63188f4557a20adc5caad79a9a/users/b461dd20a837419fb1a23f69aa60d16b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:08.035299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb208d63188f4557a20adc5caad79a9a, user_id=b461dd20a837419fb1a23f69aa60d16b, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:08.049514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:08.080851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 890/1783] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:07 2022] PUT /identity/v3/projects/cb208d63188f4557a20adc5caad79a9a/users/b461dd20a837419fb1a23f69aa60d16b/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:08.081954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:08.122619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e043e98-1d48-40b3-bf6b-c0154bd921a1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:08.320635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10415f41-0904-4630-abe0-e88ea51c7521 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:08.320836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d279d1-780a-4452-b291-4342536777e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:08.320836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d279d1-780a-4452-b291-4342536777e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:08.320836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d279d1-780a-4452-b291-4342536777e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:08.320836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d279d1-780a-4452-b291-4342536777e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:08.345350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:08.347057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:08.348043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:08.354698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:08.354698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:08.367076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:08.379017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d279d1-780a-4452-b291-4342536777e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:08.391575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d279d1-780a-4452-b291-4342536777e8 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:08.451129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 894/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:08.455272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:08.457556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:08.460047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:08.480542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 891/1785] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:08 2022] POST /identity/v3/projects => generated 387 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:08.481736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:08.566784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] MFA Rules not processed for user `b461dd20a837419fb1a23f69aa60d16b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:08.570416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:08.765378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b472bd-27d1-4b20-aed2-97f32927fa27 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:08.780857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8bca1-86db-40ea-9bd1-33db34b435f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:08.781742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8bca1-86db-40ea-9bd1-33db34b435f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:08.782199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8bca1-86db-40ea-9bd1-33db34b435f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:08.783084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8bca1-86db-40ea-9bd1-33db34b435f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:08.792151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8bca1-86db-40ea-9bd1-33db34b435f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:08.794492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8bca1-86db-40ea-9bd1-33db34b435f7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:08.881062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 892/1786] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:08 2022] POST /identity/v3/users => generated 300 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:08.883904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:08.886429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:08.886930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:08.982293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 895/1787] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:08.982293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:09.002396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:09.011021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:09.036276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:09.050954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d6912-ab0f-4e59-bd8a-9cdfc33f649e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:09.090692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:09.094850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:09.094850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:09.094850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:09.098508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:09.111414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:09.168148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 896/1788] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:09.169339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:09.175352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:09.335018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 893/1789] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Aug 24 07:58:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:09.336168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:09.373404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc21d6-1df2-46fa-8d46-019bf72ffd0f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:09.374701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:09.384355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:09.385686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:09.386215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:09.386640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] PATH_INFO: `/v3/projects/cde67fed490048659674b9d5b52b9a23/users/532224005d354cc1aa30d8d1ad8400ca/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:09.416085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf223-580c-4e17-8dda-bb1fc61207aa admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:09.420349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde67fed490048659674b9d5b52b9a23, user_id=532224005d354cc1aa30d8d1ad8400ca, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:09.426388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:09.427702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:09.429817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:09.442049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:09.443059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:09.470773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 894/1790] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:09 2022] PUT /identity/v3/projects/cde67fed490048659674b9d5b52b9a23/users/532224005d354cc1aa30d8d1ad8400ca/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:09.482466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:09.493295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:09.499175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:09.552115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 897/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:09.777453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:09.795411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5cc3-25dd-40d7-b211-a7f151244103 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:09.807553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306697b1-0f28-44af-bf06-3d56b0937e17 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:09.810405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:09.811281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:09.815836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:09.816427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] PATH_INFO: `/v3/users/0f5f3a8cfff441bf9f671f53f580a3d9` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:09.820617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5f3a8cfff441bf9f671f53f580a3d9)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:09.825254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:09.834515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:09.834515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:09.834515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:09.834515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:09.834515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:09.839323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:09.895846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 895/1792] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:09.898354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:09.905479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:09.953032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9f19-8db8-418e-8634-51075133bcbc admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:09.970684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:09.972297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:09.972297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:09.972297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] PATH_INFO: `/v3/projects/cb71171097fa4ea2bf6a2e51b5b765b6` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:09.976922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb71171097fa4ea2bf6a2e51b5b765b6)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:09.977853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5f3a8cfff441bf9f671f53f580a3d9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:09.978545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5f3a8cfff441bf9f671f53f580a3d9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:09.981480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:10.003459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5f3a8cfff441bf9f671f53f580a3d9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.027254 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5f3a8cfff441bf9f671f53f580a3d9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.054297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5f3a8cfff441bf9f671f53f580a3d9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.065680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 898/1793] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:09 2022] DELETE /identity/v3/users/0f5f3a8cfff441bf9f671f53f580a3d9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:10.066763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:10.071381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.130277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb71171097fa4ea2bf6a2e51b5b765b6', 'request_id': 'req-9c99aec6-00c3-41ea-85e7-64fbb450ffed'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.146534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb71171097fa4ea2bf6a2e51b5b765b6', 'request_id': 'req-9c99aec6-00c3-41ea-85e7-64fbb450ffed'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.173441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb71171097fa4ea2bf6a2e51b5b765b6', 'request_id': 'req-9c99aec6-00c3-41ea-85e7-64fbb450ffed'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.194445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] The token cache is being invalidate because project cb71171097fa4ea2bf6a2e51b5b765b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:10.195129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.197771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.204389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 896/1794] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:09 2022] DELETE /identity/v3/projects/cb71171097fa4ea2bf6a2e51b5b765b6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:10.204389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:10.206392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.239632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5ffed-4451-498b-be7b-c707ddd5d2c9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:10.259681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:10.394138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a2643-8d4d-4ed4-8488-f94c3b445f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:10.394963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2643-8d4d-4ed4-8488-f94c3b445f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.395108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2643-8d4d-4ed4-8488-f94c3b445f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.395374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2643-8d4d-4ed4-8488-f94c3b445f73 admin admin] PATH_INFO: `/v3/projects/cde67fed490048659674b9d5b52b9a23/users/532224005d354cc1aa30d8d1ad8400ca/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.400573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a2643-8d4d-4ed4-8488-f94c3b445f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde67fed490048659674b9d5b52b9a23, user_id=532224005d354cc1aa30d8d1ad8400ca, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:10.403344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a2643-8d4d-4ed4-8488-f94c3b445f73 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:10.414710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99aec6-00c3-41ea-85e7-64fbb450ffed admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:10.420489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:10.422540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:10.423931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.424659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.425142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.431277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.432975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 899/1795] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:10 2022] PUT /identity/v3/projects/cde67fed490048659674b9d5b52b9a23/users/532224005d354cc1aa30d8d1ad8400ca/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:10.436152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4828655-61eb-4942-ba34-df3b9c995fce None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.436634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4828655-61eb-4942-ba34-df3b9c995fce None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.436744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4828655-61eb-4942-ba34-df3b9c995fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.450518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:10.452674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:10.470647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 897/1796] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:10.472482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:10.474293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.488590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c4828655-61eb-4942-ba34-df3b9c995fce None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:10.489753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c4828655-61eb-4942-ba34-df3b9c995fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.498437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d300d-d9fd-4653-ba8c-d7ff0596c215 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:10.614302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 900/1797] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:10.615368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.615660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.615941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.674344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] MFA Rules not processed for user `532224005d354cc1aa30d8d1ad8400ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:10.675785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.683614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:10.684222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.684506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.684787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] PATH_INFO: `/v3/users/a6b421ba778246b5a805cf9925312c9d` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.690085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b421ba778246b5a805cf9925312c9d)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:10.692786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:10.815852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b421ba778246b5a805cf9925312c9d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.829609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 901/1798] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:10.830495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:10.833009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.836693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b421ba778246b5a805cf9925312c9d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.837391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b421ba778246b5a805cf9925312c9d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.875317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b421ba778246b5a805cf9925312c9d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.890888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b421ba778246b5a805cf9925312c9d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:10.908132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 898/1799] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:10 2022] DELETE /identity/v3/users/a6b421ba778246b5a805cf9925312c9d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:10.908132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:10.913475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:11.012638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:11.032055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6554085-fa60-4e66-b988-63f3900bfc58 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:11.055530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6558c-d7d7-4694-9d2e-fe116ba038c3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:11.069795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:11.070350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:11.070646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:11.070924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:11.076169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:11.231384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:11.279052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:11.287497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:11.288520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:11.289688 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:11.297031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:11.337169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:11.343298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:11.386447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 899/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:11.448837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:11.450741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:11.618034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:11.619755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1107b-529b-4cb4-b803-07fd80dca025 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:11.668568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 902/1801] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 838 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:11.795051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb3ed-4543-4970-892c-3fddc491a304 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:11.822792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:11.823477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:11.823770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:11.824062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] PATH_INFO: `/v3/users/7db6d1a133f0427688b2ec1cf9f56a52` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:11.832023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db6d1a133f0427688b2ec1cf9f56a52)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:11.840917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:11.958663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db6d1a133f0427688b2ec1cf9f56a52'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:11.984677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db6d1a133f0427688b2ec1cf9f56a52'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:11.985539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db6d1a133f0427688b2ec1cf9f56a52'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.025554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db6d1a133f0427688b2ec1cf9f56a52'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.057778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db6d1a133f0427688b2ec1cf9f56a52'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.077067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 900/1802] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:11 2022] DELETE /identity/v3/users/7db6d1a133f0427688b2ec1cf9f56a52 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:12.081349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:12.082238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:12.082657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:12.133041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:12.134502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:12.351026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 903/1803] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:12.428445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:12.431369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:12.440095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:12.547043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:12.548767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:12.602701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf31fd-05b5-4bc6-a038-9cbec5c34272 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:12.615905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:12.618580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:12.624736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:12.626076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] PATH_INFO: `/v3/projects/be7c4f07cc284498a7aa71a1358db679` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:12.630672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7c4f07cc284498a7aa71a1358db679)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:12.633542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:12.666547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88528-714b-4efb-9095-6b28f68acacf admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:12.686954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d69c3f-0bc0-4f0e-96a0-c62aa662eab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:12.688812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69c3f-0bc0-4f0e-96a0-c62aa662eab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:12.689244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69c3f-0bc0-4f0e-96a0-c62aa662eab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:12.690387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69c3f-0bc0-4f0e-96a0-c62aa662eab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:12.716485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d69c3f-0bc0-4f0e-96a0-c62aa662eab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:12.718171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d69c3f-0bc0-4f0e-96a0-c62aa662eab7 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:12.746079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 901/1804] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:12.779575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7c4f07cc284498a7aa71a1358db679', 'request_id': 'req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.790257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7c4f07cc284498a7aa71a1358db679', 'request_id': 'req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.806381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7c4f07cc284498a7aa71a1358db679', 'request_id': 'req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.832914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] The token cache is being invalidate because project be7c4f07cc284498a7aa71a1358db679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:12.833442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.835527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b0a0d866-a276-4fde-8f9a-4bbaf2b5681f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:12.845122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 904/1805] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:12 2022] DELETE /identity/v3/projects/be7c4f07cc284498a7aa71a1358db679 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:12.845308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:12.845680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:12.846034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:12.886020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:12.889795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:13.045986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 902/1806] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:13.054088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.055077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.055623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.094291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:13.095692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:13.113404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 905/1807] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:13.118399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:13.132147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1997e6-d03b-4be2-a1e0-8f18a9034af1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:13.146154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:13.147227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.147901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.148249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.149028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:13.149474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:13.151543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:13.179520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 903/1808] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:58:13.183939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:13.194963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a8394-411d-4e36-bd25-b2bda2adf4f5 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:13.213024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:13.214825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.215862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.217085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.218894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:13.222894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:13.238844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:13.291195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 906/1809] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:13 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:13.295553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:13.311700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e311f82-4bac-47d5-9db0-ce61d2bcc736 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:13.485284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:13.487421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.487699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.488748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.490758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:13.497429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:13.551340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 904/1810] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:13 2022] POST /identity/v3/users => generated 305 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:13.552649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:13.569188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b6570-a1d8-4471-93f3-a55a6e0e709b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:13.598397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:13.601876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.603059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.605145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.607024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:13.609853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:13.645028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:13.647646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 907/1811] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:13.666768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776bfc-6fe8-4a72-aad6-04981331eb92 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:13.711042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af97871-d6e8-4841-bfa9-b7b2cf393396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:13.711676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97871-d6e8-4841-bfa9-b7b2cf393396 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.711956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97871-d6e8-4841-bfa9-b7b2cf393396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.712232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97871-d6e8-4841-bfa9-b7b2cf393396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.718040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af97871-d6e8-4841-bfa9-b7b2cf393396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:13.728361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af97871-d6e8-4841-bfa9-b7b2cf393396 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:13.769984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 905/1812] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:13.775118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:13.795858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676902b9-df85-4fe8-b54a-b623e34d73c9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:13.814018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:13.814746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.815101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.815456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] PATH_INFO: `/v3/projects/a406a969d1f24028a413b289eb14101e/users/4ad8f3e533c845babeb3bcb4fc6f6c3f/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.853915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a406a969d1f24028a413b289eb14101e, user_id=4ad8f3e533c845babeb3bcb4fc6f6c3f, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:13.868788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:13.908775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 908/1813] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:13 2022] PUT /identity/v3/projects/a406a969d1f24028a413b289eb14101e/users/4ad8f3e533c845babeb3bcb4fc6f6c3f/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:13.921624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:13.922647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:13.924870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:13.999457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:14.014743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] MFA Rules not processed for user `4ad8f3e533c845babeb3bcb4fc6f6c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:14.018028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:14.264849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 906/1814] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:14.265794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:14.395823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833980de-7603-4cef-a174-41285a12ad78 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:14.411922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:14.413368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:14.413872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:14.414613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:14.415466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:14.418011 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:14.492270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 909/1815] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:14 2022] POST /identity/v3/projects => generated 409 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:14.500321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:14.545196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dc3bf-656c-4222-8684-f5c24df5d00b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:14.855905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:14.856481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:14.856768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:14.857048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:14.862475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:14.866070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:14.913657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 907/1816] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:14 2022] POST /identity/v3/users => generated 311 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:14.918472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:14.931546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add693e-852b-4154-9da1-72c8aeec7180 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:14.939730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:14.941366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:14.942177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:14.943008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:14.944705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:14.946696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:14.972498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 910/1817] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:14.977901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:14.998131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95421440-f788-4431-867e-6e73e5ab0449 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:15.057694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:15.058700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.059525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.060648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] PATH_INFO: `/v3/projects/399df06ea48e472db49326802d00fde8/users/9ff9e058196940dc9f8994e7ad5f4054/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.149415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399df06ea48e472db49326802d00fde8, user_id=9ff9e058196940dc9f8994e7ad5f4054, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:15.155658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.208650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 908/1818] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:14 2022] PUT /identity/v3/projects/399df06ea48e472db49326802d00fde8/users/9ff9e058196940dc9f8994e7ad5f4054/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:15.213134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:15.238582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f112293-7454-45a4-b92f-0a053cfe025b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:15.423530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57629-3244-473a-a343-c64472776773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:15.424321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57629-3244-473a-a343-c64472776773 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.424714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57629-3244-473a-a343-c64472776773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.425092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57629-3244-473a-a343-c64472776773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.425910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57629-3244-473a-a343-c64472776773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:15.429508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57629-3244-473a-a343-c64472776773 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.443216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 911/1819] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:15.447069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:15.463453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f6a8-73e8-44b2-8f61-246bfec3d228 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:15.510746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:15.511590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.514556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.515089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] PATH_INFO: `/v3/projects/399df06ea48e472db49326802d00fde8/users/9ff9e058196940dc9f8994e7ad5f4054/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.541401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399df06ea48e472db49326802d00fde8, user_id=9ff9e058196940dc9f8994e7ad5f4054, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:15.557289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.635105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 909/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:15 2022] PUT /identity/v3/projects/399df06ea48e472db49326802d00fde8/users/9ff9e058196940dc9f8994e7ad5f4054/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:15.646308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.647590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.648114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.759678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] MFA Rules not processed for user `9ff9e058196940dc9f8994e7ad5f4054`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:15.766870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:15.823633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:16.066856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 912/1821] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:15 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:16.083466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.085852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:16.111118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.113572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:16.319379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142e60b-b222-4a9a-a16f-c6addb2194e8 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:16.352273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:16.353185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.353665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.357138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.376164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:16.379151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:16.393558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:16.408787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e6ed-4bd2-45a4-9600-5e82e17c30c4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:16.422745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 910/1822] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:16 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:16.430138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:16.432213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.432662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.433103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] PATH_INFO: `/v3/projects/e782a3b0754e4a08ac624783f94c7684` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.435061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e782a3b0754e4a08ac624783f94c7684)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:16.441673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:16.587947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e782a3b0754e4a08ac624783f94c7684', 'request_id': 'req-2c53fae0-76e7-4491-900f-aa6dd64da0e2'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.619058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e782a3b0754e4a08ac624783f94c7684', 'request_id': 'req-2c53fae0-76e7-4491-900f-aa6dd64da0e2'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.640574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e782a3b0754e4a08ac624783f94c7684', 'request_id': 'req-2c53fae0-76e7-4491-900f-aa6dd64da0e2'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.679231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] The token cache is being invalidate because project e782a3b0754e4a08ac624783f94c7684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:16.682310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.685338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.687892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 913/1823] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:16 2022] DELETE /identity/v3/projects/e782a3b0754e4a08ac624783f94c7684 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:16.691932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.714596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abd3f-32ad-483d-a896-115ee7e912ab service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:16.885114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.886621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:16.955482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:16.956807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.957092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.957389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] PATH_INFO: `/v3/users/b461dd20a837419fb1a23f69aa60d16b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.960361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b461dd20a837419fb1a23f69aa60d16b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:16.962357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:16.995651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:17.048090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53fae0-76e7-4491-900f-aa6dd64da0e2 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:17.053503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:17.054107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.054386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.054663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.062613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:17.083127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b461dd20a837419fb1a23f69aa60d16b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:17.100234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b461dd20a837419fb1a23f69aa60d16b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:17.101707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b461dd20a837419fb1a23f69aa60d16b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:17.135310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b461dd20a837419fb1a23f69aa60d16b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:17.154887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fed1d517-205e-43be-93de-9a02b4304a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b461dd20a837419fb1a23f69aa60d16b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:17.173485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 911/1824] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:16 2022] DELETE /identity/v3/users/b461dd20a837419fb1a23f69aa60d16b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:17.200575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:17.202800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b9dc-c2ae-4e49-b192-14cedc0f896b service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:17.214808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 914/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:16 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:17.344306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c8f4-a204-4d21-80b8-77303e183f7b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.347658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c8f4-a204-4d21-80b8-77303e183f7b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.347658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c8f4-a204-4d21-80b8-77303e183f7b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.350729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 912/1826] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:58:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:58:17.395764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.396429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.396938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.430210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:17.433235 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:17.593939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 915/1827] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:58:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:18.142529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c8f4-a204-4d21-80b8-77303e183f7b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:18.144851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e644c8f4-a204-4d21-80b8-77303e183f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:18.290766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:18.292739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:18.300398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c8f4-a204-4d21-80b8-77303e183f7b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:18.312858 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:18.314865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:18.315157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:18.316334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871bdf-d404-4b91-b64c-7ec9f7f93639 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:18.316905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] PATH_INFO: `/v3/projects/3a5a63a714044462a52d7de331b80514` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:18.322602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5a63a714044462a52d7de331b80514)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:18.327554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:18.329496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:18.329746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:18.330234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:18.331261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:18.353752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:18.356331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:18.371098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 916/1828] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:18.394166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:18.454756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5a63a714044462a52d7de331b80514', 'request_id': 'req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.465762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5a63a714044462a52d7de331b80514', 'request_id': 'req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.480323 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5a63a714044462a52d7de331b80514', 'request_id': 'req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.496246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] The token cache is being invalidate because project 3a5a63a714044462a52d7de331b80514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:18.496839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.497814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.500025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 913/1829] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:18 2022] DELETE /identity/v3/projects/3a5a63a714044462a52d7de331b80514 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:18.506896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:18.526625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f4a5-9da8-4587-8ba1-0764f6d7123a service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:18.551716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:18.553897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:18.614929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:18.616498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:18.616808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:18.617244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] PATH_INFO: `/v3/users/532224005d354cc1aa30d8d1ad8400ca` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:18.619446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532224005d354cc1aa30d8d1ad8400ca)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:18.621429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:18.636755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:18.671103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f38e7-18a2-4ae5-8668-9071576ed7c9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:18.675955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:18.676602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:18.676884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:18.677158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] PATH_INFO: `/v3/projects/cb208d63188f4557a20adc5caad79a9a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:18.678914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb208d63188f4557a20adc5caad79a9a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:18.680829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:18.681576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532224005d354cc1aa30d8d1ad8400ca'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.682340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532224005d354cc1aa30d8d1ad8400ca'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.694886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532224005d354cc1aa30d8d1ad8400ca'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.709749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532224005d354cc1aa30d8d1ad8400ca'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.719355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aef04eb2-0f6a-4f03-9440-4238ea9a5561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532224005d354cc1aa30d8d1ad8400ca'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.729109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 917/1830] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:18 2022] DELETE /identity/v3/users/532224005d354cc1aa30d8d1ad8400ca => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:18.772845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb208d63188f4557a20adc5caad79a9a', 'request_id': 'req-7df6150a-a1c6-4b4f-b470-ba3753e551ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.781929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb208d63188f4557a20adc5caad79a9a', 'request_id': 'req-7df6150a-a1c6-4b4f-b470-ba3753e551ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.793615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb208d63188f4557a20adc5caad79a9a', 'request_id': 'req-7df6150a-a1c6-4b4f-b470-ba3753e551ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.824479 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] The token cache is being invalidate because project cb208d63188f4557a20adc5caad79a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:18.824821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.825667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-7df6150a-a1c6-4b4f-b470-ba3753e551ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:18.829052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 914/1831] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:18 2022] DELETE /identity/v3/projects/cb208d63188f4557a20adc5caad79a9a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:18.837148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:18.837772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:18.838093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:18.892732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:18.894020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:19.012134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 918/1832] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:19.014188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d5b6-8dc5-40f9-9d35-fefba6ef362d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.015167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d5b6-8dc5-40f9-9d35-fefba6ef362d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.015167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d5b6-8dc5-40f9-9d35-fefba6ef362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.055251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a589d5b6-8dc5-40f9-9d35-fefba6ef362d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:19.055648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a589d5b6-8dc5-40f9-9d35-fefba6ef362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:19.077332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 915/1833] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:19.078653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.098047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f1748-1bae-44fc-a965-36b376c54192 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.105941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24506a-aba8-4330-8112-a51c6be4f55d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.106227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24506a-aba8-4330-8112-a51c6be4f55d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.106509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24506a-aba8-4330-8112-a51c6be4f55d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.108199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 916/1834] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:58:19.112139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287b544-8440-4185-830c-328517540383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.113171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b544-8440-4185-830c-328517540383 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.113414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.113702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.114006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.114321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b544-8440-4185-830c-328517540383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.115892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b544-8440-4185-830c-328517540383 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.118576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287b544-8440-4185-830c-328517540383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:19.119811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287b544-8440-4185-830c-328517540383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.123936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287b544-8440-4185-830c-328517540383 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.139143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:19.140007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:19.156452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 919/1835] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:19.161502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287b544-8440-4185-830c-328517540383 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.176894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287b544-8440-4185-830c-328517540383 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.183323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.183323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.183323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.183903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.197167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.199529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:19.203446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.271194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 920/1836] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:19.273486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.284881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 917/1837] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:19.358954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:19.365329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b112-983c-471f-9017-a597d3bf9aea admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.373097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.374279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.374630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.375808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.377126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.379921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.405663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 921/1838] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:19 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:19.409938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.421673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f821cc-e78c-4046-83b9-6619e6d03ab5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.426467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.427079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.427356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.427660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.428290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.429933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.440789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 918/1839] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:19.444994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.455573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398d95e-a279-4548-aa44-9248f448e06b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.461649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2fce0-39e6-4605-876f-0742390687af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.462278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2fce0-39e6-4605-876f-0742390687af admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.462568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2fce0-39e6-4605-876f-0742390687af admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.462852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2fce0-39e6-4605-876f-0742390687af admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.463679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2fce0-39e6-4605-876f-0742390687af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.465375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2fce0-39e6-4605-876f-0742390687af admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.479221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 922/1840] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:19.487244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.499357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a788e78-b177-458d-8383-aadfbfd62bce admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.505054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.506007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.506707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.507177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] PATH_INFO: `/v3/projects/cef9a15ceddc4b4b95e7a6be29459ec7/users/d58a3855429e467c9adb483f955f19c9/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.527841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef9a15ceddc4b4b95e7a6be29459ec7, user_id=d58a3855429e467c9adb483f955f19c9, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.531559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.553350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 919/1841] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:19 2022] PUT /identity/v3/projects/cef9a15ceddc4b4b95e7a6be29459ec7/users/d58a3855429e467c9adb483f955f19c9/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:19.558499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.559028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.559122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.592342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] MFA Rules not processed for user `d58a3855429e467c9adb483f955f19c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:19.594174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:19.790080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 923/1842] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:19.793986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.839880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.841876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:19.908511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e6fa0-af78-434e-b714-2de544326274 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.916933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.918257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.918551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.918831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.920108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.923301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:19.951494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be23c5-ec9b-48f4-96bb-3a4f65b60d47 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:19.964539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 920/1843] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:19.964539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:19.964539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:19.977576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:19.978178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:19.978465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:19.978754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] PATH_INFO: `/v3/projects/cde67fed490048659674b9d5b52b9a23` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:19.979935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde67fed490048659674b9d5b52b9a23)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:19.981894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.064317 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde67fed490048659674b9d5b52b9a23', 'request_id': 'req-00ebeb99-54ac-4261-8282-2e2db7a7242e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:20.081445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde67fed490048659674b9d5b52b9a23', 'request_id': 'req-00ebeb99-54ac-4261-8282-2e2db7a7242e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:20.083065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde67fed490048659674b9d5b52b9a23', 'request_id': 'req-00ebeb99-54ac-4261-8282-2e2db7a7242e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:20.091094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:20.096516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b148348-391e-43be-9369-dae9b336df9c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.102627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] The token cache is being invalidate because project cde67fed490048659674b9d5b52b9a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:20.104496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:20.105440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:20.106933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:20.111720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 924/1844] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:19 2022] DELETE /identity/v3/projects/cde67fed490048659674b9d5b52b9a23 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:20.111720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.112741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.209896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebeb99-54ac-4261-8282-2e2db7a7242e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.212657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.213304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.213596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.213873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.215698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.215982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.216727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.217083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.217575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.218374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.220569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.230145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.232543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553c35a-7753-417d-9e44-b7539183ba64 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.247710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 921/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:20.249202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8d1d-f1d4-421d-a5ff-6c84843d3d09 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.249553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8d1d-f1d4-421d-a5ff-6c84843d3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.249911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8d1d-f1d4-421d-a5ff-6c84843d3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.262461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 925/1846] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:20.263538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.278083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6662-47b0-4c6f-8a9b-a38bd57c515c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.280494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-80bf8d1d-f1d4-421d-a5ff-6c84843d3d09 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:20.281791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-80bf8d1d-f1d4-421d-a5ff-6c84843d3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.287540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.288681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.289058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.289741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.290724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.293005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 922/1847] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:20.293602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.301433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.301968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.302248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.314153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 926/1848] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:20.315483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.330000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cedbc-96af-445b-9aba-2a3d517d9bc7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.346785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:20.348024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.350226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.351087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.353190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.354353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.355300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.358756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.370335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 923/1849] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:20.374618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.390091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b108cb-0aea-4963-9a8d-bb7a16411574 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.396149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 927/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:20.397439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.403045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.403045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.404750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.405112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.405870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:20.406673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.410334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.420312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbebd-c576-456d-a22e-e975d726e38e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.438439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 924/1851] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:58:20.442667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.444889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96157a-3b01-48b2-a5a2-c1dc098f7b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.445779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96157a-3b01-48b2-a5a2-c1dc098f7b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.446065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96157a-3b01-48b2-a5a2-c1dc098f7b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.446343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96157a-3b01-48b2-a5a2-c1dc098f7b5f admin admin] PATH_INFO: `/v3/projects/df6608871603423e9ae57a39612bab02/users/18751e463c17424fb333fb80ecaa9f17/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.462520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4329f9-3ebc-4869-97d0-afb1ea8a8815 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.470095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.470724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.471003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.471275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.472760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.475365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.477524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96157a-3b01-48b2-a5a2-c1dc098f7b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6608871603423e9ae57a39612bab02, user_id=18751e463c17424fb333fb80ecaa9f17, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.482545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96157a-3b01-48b2-a5a2-c1dc098f7b5f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.515435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 925/1852] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:20.516561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.528363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 928/1853] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:20 2022] PUT /identity/v3/projects/df6608871603423e9ae57a39612bab02/users/18751e463c17424fb333fb80ecaa9f17/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:20.541409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.541696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.541976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.603007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] MFA Rules not processed for user `18751e463c17424fb333fb80ecaa9f17`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:20.604250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.650020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c765f7-7f09-43b7-89b8-6156465fab3a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.660464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.662452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.665949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.666292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.668422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.674858 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.701381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 929/1854] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:20.705832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.722906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8e3d-95d9-48a2-a788-e6c00629d7c9 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.730290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 926/1855] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:20.731288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.733350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.733996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.734279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.738114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.738849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.743481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.752726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ccd19-bbdb-4ff1-b7c4-672075ad007b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.767990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.768622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.769542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.769823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.779429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.779429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.796198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 927/1856] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:20.803760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.817239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 930/1857] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:20.818696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.824402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:20.827118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f807-bf88-48f5-b8c0-e1d03206cb6f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.902709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:20.938345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb71c8-fdf7-4f54-bf7f-6b3a95c5cd15 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.945135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.945839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.946119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.946388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.947013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.949844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.985715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 931/1858] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:20.986438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.986577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.987501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.987948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.988368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.989160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.990961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.998742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1f21e-c345-4128-a7c2-784127d19b33 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.004888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.006119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.006433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.006793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.007440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.009203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.020356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 928/1859] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:21.025621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:21.029483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 932/1860] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:21.030838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:21.044555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f7774-bdb5-4ec7-a621-49deb82fc8b8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.047775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b06b-494c-4d02-8e97-1e9a8aa2b263 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.050686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.051446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.051806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.052164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] PATH_INFO: `/v3/projects/14c1a5339319472abb992cd31449bc4a/users/3aae1ace0b6441268a8874d72d0f8de7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.054028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14584d98-55ba-4d47-915d-8f1589833e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.054699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584d98-55ba-4d47-915d-8f1589833e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.054980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584d98-55ba-4d47-915d-8f1589833e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.055264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584d98-55ba-4d47-915d-8f1589833e8f admin admin] PATH_INFO: `/v3/projects/8eefde89ea944be4bbda74ba799646b8/users/0125edb273554fe086e622a119e84fd9/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.080065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c1a5339319472abb992cd31449bc4a, user_id=3aae1ace0b6441268a8874d72d0f8de7, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.082296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584d98-55ba-4d47-915d-8f1589833e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eefde89ea944be4bbda74ba799646b8, user_id=0125edb273554fe086e622a119e84fd9, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.083147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.088361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584d98-55ba-4d47-915d-8f1589833e8f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.105305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 933/1861] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:21 2022] PUT /identity/v3/projects/14c1a5339319472abb992cd31449bc4a/users/3aae1ace0b6441268a8874d72d0f8de7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:21.106772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:21.107433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 929/1862] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:21 2022] PUT /identity/v3/projects/8eefde89ea944be4bbda74ba799646b8/users/0125edb273554fe086e622a119e84fd9/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:21.118722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.119325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.120030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.157104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] MFA Rules not processed for user `0125edb273554fe086e622a119e84fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:21.159203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:21.197526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabe808-8671-4daf-bf00-7009072b9337 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.241675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 930/1863] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:21.254351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:21.256515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:21.284702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.285823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.286987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.287472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.288322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.290961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.306125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 934/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:21.311650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:21.318752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:21.326763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841e2e-9e72-44f4-a6df-44f9f25e8cb9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.327506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d350-5b0e-46a1-8115-9bea44497982 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.333178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800f204-60d3-4057-9e1b-1b0f3daa7996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.334130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f204-60d3-4057-9e1b-1b0f3daa7996 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.334433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f204-60d3-4057-9e1b-1b0f3daa7996 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.334888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f204-60d3-4057-9e1b-1b0f3daa7996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.340783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.342069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.342326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.342606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] PATH_INFO: `/v3/projects/14c1a5339319472abb992cd31449bc4a/users/3aae1ace0b6441268a8874d72d0f8de7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.351103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c1a5339319472abb992cd31449bc4a, user_id=3aae1ace0b6441268a8874d72d0f8de7, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.354076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.355028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800f204-60d3-4057-9e1b-1b0f3daa7996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.356548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800f204-60d3-4057-9e1b-1b0f3daa7996 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.378060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 931/1865] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:21.380353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 935/1866] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:21 2022] PUT /identity/v3/projects/14c1a5339319472abb992cd31449bc4a/users/3aae1ace0b6441268a8874d72d0f8de7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:21.391454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.391995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.392321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.433971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] MFA Rules not processed for user `3aae1ace0b6441268a8874d72d0f8de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:21.436118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:21.459951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:21.531336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 932/1867] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:21.553826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:21.556598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:21.658018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847b9d0-bfce-43e5-b0e0-6bdd60df0297 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:21.663726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:21.664368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:21.664651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:21.664925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:21.682087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:21.683601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:21.703882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 936/1868] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:22.503627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:22.516561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ee70-ee85-4e78-92f5-45e57b392596 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:22.520777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:22.522254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:22.522366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:22.522749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:22.525078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:22.592579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:22.594029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99874c2b-0123-4118-a1d6-c2349540d176 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:22.602952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 933/1869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:23.451402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:23.452861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:23.521065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766d9db-6753-4b29-9f33-6e932264e04b service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:23.526944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:23.527582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:23.527865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:23.528140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] PATH_INFO: `/v3/users/4ad8f3e533c845babeb3bcb4fc6f6c3f` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:23.529270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad8f3e533c845babeb3bcb4fc6f6c3f)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:23.531239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:23.589809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad8f3e533c845babeb3bcb4fc6f6c3f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:23.590554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad8f3e533c845babeb3bcb4fc6f6c3f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:23.599045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad8f3e533c845babeb3bcb4fc6f6c3f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:23.612571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad8f3e533c845babeb3bcb4fc6f6c3f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:23.621442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad8f3e533c845babeb3bcb4fc6f6c3f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:23.628559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 937/1870] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:23 2022] DELETE /identity/v3/users/4ad8f3e533c845babeb3bcb4fc6f6c3f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:23.633170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:23.633673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:23.633764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:23.653287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:23.654513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:23.723918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 934/1871] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:23.733426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:23.734812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:23.748569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:23.793664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691682-5361-4018-85ed-06d693a67ea6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:23.797393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:23.797992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:23.798268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:23.798540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:23.807489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:23.808895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:23.817971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 938/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:24.086881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:24.088596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:24.108745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5de8-b334-446d-b6a9-067704dbfe9f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:24.113802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:24.114445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:24.114726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:24.115535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] PATH_INFO: `/v3/projects/a406a969d1f24028a413b289eb14101e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:24.116775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a406a969d1f24028a413b289eb14101e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:24.118645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:24.210275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a406a969d1f24028a413b289eb14101e', 'request_id': 'req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.214238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:24.227233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a406a969d1f24028a413b289eb14101e', 'request_id': 'req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.248985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a406a969d1f24028a413b289eb14101e', 'request_id': 'req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.268606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] The token cache is being invalidate because project a406a969d1f24028a413b289eb14101e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:24.268976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.270954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.278294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 935/1873] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:24 2022] DELETE /identity/v3/projects/a406a969d1f24028a413b289eb14101e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:24.279898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:24.294284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe040300-598b-4589-8bdf-ba57814ef002 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:24.404447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:24.405122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:24.405506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:24.405847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] PATH_INFO: `/v3/users/9ff9e058196940dc9f8994e7ad5f4054` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:24.407190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff9e058196940dc9f8994e7ad5f4054)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:24.409497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:24.499896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff9e058196940dc9f8994e7ad5f4054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.500565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff9e058196940dc9f8994e7ad5f4054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.512713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff9e058196940dc9f8994e7ad5f4054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.530462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff9e058196940dc9f8994e7ad5f4054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.539113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-842518b8-250f-435d-91e8-c94bfcbe0c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff9e058196940dc9f8994e7ad5f4054'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:24.545493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 939/1874] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:24 2022] DELETE /identity/v3/users/9ff9e058196940dc9f8994e7ad5f4054 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:25.047835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.049390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:25.069194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda71e-ff0b-4acf-9f64-31b52fdebf3a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.136232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.137027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.137345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.137624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] PATH_INFO: `/v3/projects/399df06ea48e472db49326802d00fde8` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.138845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399df06ea48e472db49326802d00fde8)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.140754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.194378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399df06ea48e472db49326802d00fde8', 'request_id': 'req-4e7d7fe0-c72f-4599-b676-ee46b7c31381'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:25.201395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399df06ea48e472db49326802d00fde8', 'request_id': 'req-4e7d7fe0-c72f-4599-b676-ee46b7c31381'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:25.210026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399df06ea48e472db49326802d00fde8', 'request_id': 'req-4e7d7fe0-c72f-4599-b676-ee46b7c31381'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:25.220549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] The token cache is being invalidate because project 399df06ea48e472db49326802d00fde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:25.220956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:25.221612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4e7d7fe0-c72f-4599-b676-ee46b7c31381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:25.223092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 936/1875] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:25 2022] DELETE /identity/v3/projects/399df06ea48e472db49326802d00fde8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:25.228675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.228965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.229246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.248733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:25.250248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:25.282877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:25.322970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 940/1876] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:25.331014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61066740-cc45-48de-a72f-82058c59d746 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.331637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61066740-cc45-48de-a72f-82058c59d746 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.332349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61066740-cc45-48de-a72f-82058c59d746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.363190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-61066740-cc45-48de-a72f-82058c59d746 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:25.364471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-61066740-cc45-48de-a72f-82058c59d746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:25.388634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 937/1877] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:25.394322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.405877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d8c15-593f-45ac-a73c-dc17e8f676c3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.411258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.412414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.412804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.413291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.414041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:25.414444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.417019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.435195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 941/1878] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:25.436014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61066740-cc45-48de-a72f-82058c59d746 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.446423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61066740-cc45-48de-a72f-82058c59d746 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.452151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.452617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.452896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.453165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.453819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.455730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.485733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 938/1879] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:25 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:25.489967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.501886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ae20-3e23-4367-bab6-da5a1c3e724d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.575607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.576453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.576690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.577400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.578232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.585659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.628435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 942/1880] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:25 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:25.630078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.648508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd8634-e2ed-4232-8fad-a0749871d291 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.659988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.660617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.660895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.661166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.661904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.664100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.679535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 939/1881] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:25.683516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.696371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477467-346e-4aa4-820f-633af55117d5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.701181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001de376-0674-4d1c-9500-a026b4a1b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.701767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de376-0674-4d1c-9500-a026b4a1b963 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.702049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de376-0674-4d1c-9500-a026b4a1b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.702323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de376-0674-4d1c-9500-a026b4a1b963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.702967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001de376-0674-4d1c-9500-a026b4a1b963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.704559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001de376-0674-4d1c-9500-a026b4a1b963 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.716364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 943/1882] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:25.720688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.731370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a4777-26c4-4c54-be25-2a9612c1fcdd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.735959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.736610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.736888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.737187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] PATH_INFO: `/v3/projects/447bf0fc719643d096bb751e33552d85/users/1f680d92d8354527a9c70e6ebea3fe13/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.753932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447bf0fc719643d096bb751e33552d85, user_id=1f680d92d8354527a9c70e6ebea3fe13, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.756675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.771785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 940/1883] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:25 2022] PUT /identity/v3/projects/447bf0fc719643d096bb751e33552d85/users/1f680d92d8354527a9c70e6ebea3fe13/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:25.783781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.784070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.784349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.815341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] MFA Rules not processed for user `1f680d92d8354527a9c70e6ebea3fe13`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:25.816869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:25.905860 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 944/1884] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:25.910354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:25.918015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:25.979200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264cda-c7fb-41df-9fe8-994111d46ac3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:25.983760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:25.984367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:25.984650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:25.984921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:25.985583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:25.987476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.019070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 941/1885] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:25 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:26.020102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.032176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f52e58-058b-46a1-99a5-dfbc0a5ba3d1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.064533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:26.113965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.114670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.114976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.115740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.115863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.119853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.149305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 945/1886] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:26 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:26.151511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.162244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13bb8-40c9-4d64-a521-127095056729 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.167146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.167758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.168035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.168303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.168933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.170574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.182248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 942/1887] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:26.186454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.198443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7fd9-0c5c-4160-8dc4-4f9fc9f3e9b6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.205089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.206083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.206521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.206987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] PATH_INFO: `/v3/projects/bb222354800842e9920aa661453caf13/users/6462003b4df34ba7921e8ac8dbda62e4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.228299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb222354800842e9920aa661453caf13, user_id=6462003b4df34ba7921e8ac8dbda62e4, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.231384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.245949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 946/1888] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:26 2022] PUT /identity/v3/projects/bb222354800842e9920aa661453caf13/users/6462003b4df34ba7921e8ac8dbda62e4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:26.249799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.260887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4eb72-dd90-4be6-88a8-8266a3c0ddae admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.321393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff0c5-6758-4ce9-8e91-dfe89d630526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.322017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff0c5-6758-4ce9-8e91-dfe89d630526 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.322323 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff0c5-6758-4ce9-8e91-dfe89d630526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.322564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff0c5-6758-4ce9-8e91-dfe89d630526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.323204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff0c5-6758-4ce9-8e91-dfe89d630526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.324794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff0c5-6758-4ce9-8e91-dfe89d630526 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.340647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 943/1889] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:26.342015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.352693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbcc55-e34a-4dce-a689-b796b150c976 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.357405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.358067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.358345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.358615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] PATH_INFO: `/v3/projects/bb222354800842e9920aa661453caf13/users/6462003b4df34ba7921e8ac8dbda62e4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.360524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb222354800842e9920aa661453caf13, user_id=6462003b4df34ba7921e8ac8dbda62e4, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.363300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.374610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 947/1890] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:26 2022] PUT /identity/v3/projects/bb222354800842e9920aa661453caf13/users/6462003b4df34ba7921e8ac8dbda62e4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:26.385588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.385875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.386149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.415466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] MFA Rules not processed for user `6462003b4df34ba7921e8ac8dbda62e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:26.416669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:26.484314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:26.487681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 944/1891] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:26.498968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.500652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:26.559217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2acb1d-6870-4f74-9cfa-9eb97580e959 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.562905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af536-a409-4eb0-ab00-24c55e0a93e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.563514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af536-a409-4eb0-ab00-24c55e0a93e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.563797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af536-a409-4eb0-ab00-24c55e0a93e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.564069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af536-a409-4eb0-ab00-24c55e0a93e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.623401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af536-a409-4eb0-ab00-24c55e0a93e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.624829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af536-a409-4eb0-ab00-24c55e0a93e3 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.634364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 948/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:26.663748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:26.665336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:26.677892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bec32-422e-42b0-a6dd-93c88b36497b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:26.681613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:26.682221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:26.682503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:26.682774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:26.684472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:26.748451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:26.749946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98093-2e34-4a36-a70b-5f5af7e4c1c8 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:26.758956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 945/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:27.801649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6db013-db02-4138-946f-f8306e9a180f None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:27.802622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6db013-db02-4138-946f-f8306e9a180f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:27.802910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6db013-db02-4138-946f-f8306e9a180f None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:27.805310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 949/1894] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:58:27.816515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:27.817043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:27.817338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:27.845130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:27.847115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:27.928704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 946/1895] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:58:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:27.941146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6db013-db02-4138-946f-f8306e9a180f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:27.943007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8a6db013-db02-4138-946f-f8306e9a180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:27.961239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6db013-db02-4138-946f-f8306e9a180f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:27.966979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03b56-5a70-4abd-8cf7-34ba71530592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:27.967684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03b56-5a70-4abd-8cf7-34ba71530592 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:27.967905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03b56-5a70-4abd-8cf7-34ba71530592 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:27.968179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03b56-5a70-4abd-8cf7-34ba71530592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:27.977775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03b56-5a70-4abd-8cf7-34ba71530592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:27.979345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03b56-5a70-4abd-8cf7-34ba71530592 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:27.990737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 950/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:29.295319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:29.296751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:29.361446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100329e-c2e5-498d-a484-27f47b0b2e53 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:29.366346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:29.367066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:29.367376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:29.367703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] PATH_INFO: `/v3/users/d58a3855429e467c9adb483f955f19c9` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:29.368818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58a3855429e467c9adb483f955f19c9)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:29.370873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:29.407277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:29.421956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58a3855429e467c9adb483f955f19c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:29.430197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58a3855429e467c9adb483f955f19c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:29.430864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58a3855429e467c9adb483f955f19c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:29.444498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58a3855429e467c9adb483f955f19c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:29.451944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58a3855429e467c9adb483f955f19c9'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:29.458166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 947/1897] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:29 2022] DELETE /identity/v3/users/d58a3855429e467c9adb483f955f19c9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:29.462951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:29.464044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:29.464535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:29.496197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:29.497643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:29.541402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:29.628469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 951/1898] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:29.643260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:29.645064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:29.771744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f9b42-07f7-471c-9ec0-e01b619e7601 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:29.786278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:29.786278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:29.786278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:29.786278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:29.810404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:29.812375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:29.840039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 948/1899] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:30.204350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:30.206342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:30.229895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ec16a-569d-4b4a-9e71-1a5e696fa4dd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:30.236854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:30.237515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:30.237907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:30.238515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] PATH_INFO: `/v3/projects/cef9a15ceddc4b4b95e7a6be29459ec7` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:30.239932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef9a15ceddc4b4b95e7a6be29459ec7)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:30.242699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:30.293488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef9a15ceddc4b4b95e7a6be29459ec7', 'request_id': 'req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.299840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef9a15ceddc4b4b95e7a6be29459ec7', 'request_id': 'req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.307352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef9a15ceddc4b4b95e7a6be29459ec7', 'request_id': 'req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.317505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] The token cache is being invalidate because project cef9a15ceddc4b4b95e7a6be29459ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:30.317795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.318440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.319916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 952/1900] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:30 2022] DELETE /identity/v3/projects/cef9a15ceddc4b4b95e7a6be29459ec7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:30.323962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:30.334043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a625-e25c-4a6a-a72c-26009781f8a5 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:30.390462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:30.391013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:30.391294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:30.391565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] PATH_INFO: `/v3/users/18751e463c17424fb333fb80ecaa9f17` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:30.392659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=18751e463c17424fb333fb80ecaa9f17)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:30.394774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:30.439744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18751e463c17424fb333fb80ecaa9f17'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.447553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18751e463c17424fb333fb80ecaa9f17'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.448168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18751e463c17424fb333fb80ecaa9f17'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.449275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:30.463515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18751e463c17424fb333fb80ecaa9f17'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.470210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18751e463c17424fb333fb80ecaa9f17'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.476030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 949/1901] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:30 2022] DELETE /identity/v3/users/18751e463c17424fb333fb80ecaa9f17 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:30.994569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:30.996087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.010457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce3fcb-f1aa-40fd-8760-fbd5bd62f613 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.077993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.079385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.080318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.080696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] PATH_INFO: `/v3/projects/df6608871603423e9ae57a39612bab02` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.090890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6608871603423e9ae57a39612bab02)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.093651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.235237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:31.236988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6608871603423e9ae57a39612bab02', 'request_id': 'req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.249193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6608871603423e9ae57a39612bab02', 'request_id': 'req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.273118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6608871603423e9ae57a39612bab02', 'request_id': 'req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.288023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] The token cache is being invalidate because project df6608871603423e9ae57a39612bab02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:31.288423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.289162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.291093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 953/1902] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:30 2022] DELETE /identity/v3/projects/df6608871603423e9ae57a39612bab02 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:31.305576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.305576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.314611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd79f7-e804-4f09-8d07-d60daee283ad admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.319708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.322338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.419284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e28-b84a-44e1-a5ab-2c097a5a8b20 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.419861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.421214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.421743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.422234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] PATH_INFO: `/v3/users/3aae1ace0b6441268a8874d72d0f8de7` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.423321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.424384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.424384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.424744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.425192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aae1ace0b6441268a8874d72d0f8de7)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.429291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.430635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.493546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aae1ace0b6441268a8874d72d0f8de7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.504367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aae1ace0b6441268a8874d72d0f8de7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.505595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aae1ace0b6441268a8874d72d0f8de7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.521873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aae1ace0b6441268a8874d72d0f8de7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.531826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aae1ace0b6441268a8874d72d0f8de7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.540362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.541874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e5a8-b1fe-4f6d-ba16-52a1b8748297 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.551653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 950/1903] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:31 2022] DELETE /identity/v3/users/3aae1ace0b6441268a8874d72d0f8de7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:31.556161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 954/1904] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:31.859949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.861475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.930288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:31.944726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc575f-05ed-476c-8ae4-be4401e9d8d9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.949743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.950505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.950791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.951069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] PATH_INFO: `/v3/projects/14c1a5339319472abb992cd31449bc4a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.952178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c1a5339319472abb992cd31449bc4a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.954101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.002218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c1a5339319472abb992cd31449bc4a', 'request_id': 'req-665c3ce4-920a-4d74-b809-a2c820f7837d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:32.009064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c1a5339319472abb992cd31449bc4a', 'request_id': 'req-665c3ce4-920a-4d74-b809-a2c820f7837d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:32.015801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c1a5339319472abb992cd31449bc4a', 'request_id': 'req-665c3ce4-920a-4d74-b809-a2c820f7837d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:32.026809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] The token cache is being invalidate because project 14c1a5339319472abb992cd31449bc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:32.027099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:32.027723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-665c3ce4-920a-4d74-b809-a2c820f7837d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:32.029203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 951/1905] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:31 2022] DELETE /identity/v3/projects/14c1a5339319472abb992cd31449bc4a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:32.035241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.035694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.035784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.055337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:32.056520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:32.116313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 955/1906] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:32.124938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.125232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.125548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.163364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:32.164984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:32.179728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 952/1907] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:32.180946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.191324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ede94-84db-4abe-9691-986a828a1be9 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.198345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.198967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.199248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.199650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.200626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:32.200626 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.202268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.217319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 956/1908] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:32.220175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.230583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02a0a8-3349-40ff-8d35-74207e58dfc1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.235351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.236099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.236383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.236654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.237301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.239242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.271833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 953/1909] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:32.275895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.288553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34fdfb-3469-4b5a-92e9-0b08fbf90a39 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.300017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:32.360584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.361298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.361587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.361864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.362505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.364443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.395466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 957/1910] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:32.399484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.409970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a2ad2-97a1-4204-bf60-936cd104c5c7 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.414920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.415525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.415807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.416278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.416775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.418295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.429965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 954/1911] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:32.434127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.445527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e681b3-df19-4705-9c57-edd152483528 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.451670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdc665-5560-49f6-8fed-504f7add4f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.452283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc665-5560-49f6-8fed-504f7add4f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.452561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc665-5560-49f6-8fed-504f7add4f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.452859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc665-5560-49f6-8fed-504f7add4f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.453529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdc665-5560-49f6-8fed-504f7add4f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.455326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdc665-5560-49f6-8fed-504f7add4f48 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.467714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 958/1912] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:32.471890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.482817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827992-d8ab-49fd-a642-9d41016beca1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.487383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.488031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.488308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.488579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] PATH_INFO: `/v3/projects/987f77f64b0743dc811f20147e010f51/users/524e9883bfc14952a8c3c75d23240f9c/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.504436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] RBAC: Authorizing `identity:create_grant(project_id=987f77f64b0743dc811f20147e010f51, user_id=524e9883bfc14952a8c3c75d23240f9c, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.507655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.520980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 955/1913] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:32 2022] PUT /identity/v3/projects/987f77f64b0743dc811f20147e010f51/users/524e9883bfc14952a8c3c75d23240f9c/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:32.534454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.534740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.535019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.563421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] MFA Rules not processed for user `524e9883bfc14952a8c3c75d23240f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:32.571751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:32.643236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 959/1914] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:32.647160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.728233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d85f3-0000-4421-8a6a-d6eb04b8547f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.732887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.733518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.733795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.734063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.734738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.736607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.767149 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 956/1915] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:32.768360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.779247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41e872-97e9-45ca-ab39-e728eb558927 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.839217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.840012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.840411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.840739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.841575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.843553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.866261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 960/1916] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:32.870289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.875767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:32.882298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb60ac-a681-4c75-8253-b36f98d5bac2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.888377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.888995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.889585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.889859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.890496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.892121 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.903287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 957/1917] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:32.907426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.918472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ce94d-b59d-4399-8e78-c4e665949101 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.927996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.927996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.927996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.927996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] PATH_INFO: `/v3/projects/1b836974e7234c58ae54d4c86c7ef38c/users/fd3b906f4cad43e9a183d46dd3d6c559/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.937927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:32.945866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b836974e7234c58ae54d4c86c7ef38c, user_id=fd3b906f4cad43e9a183d46dd3d6c559, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.948722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.961955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 961/1918] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:32 2022] PUT /identity/v3/projects/1b836974e7234c58ae54d4c86c7ef38c/users/fd3b906f4cad43e9a183d46dd3d6c559/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:32.965925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.976439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006828d6-b7fa-4df9-b5e0-126ef39ca628 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:33.033247 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f6a57-3c95-4b2d-87c7-0f5db787d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:33.033856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f6a57-3c95-4b2d-87c7-0f5db787d926 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.034135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f6a57-3c95-4b2d-87c7-0f5db787d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.034408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f6a57-3c95-4b2d-87c7-0f5db787d926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.035043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f6a57-3c95-4b2d-87c7-0f5db787d926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:33.037187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f6a57-3c95-4b2d-87c7-0f5db787d926 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:33.050049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 958/1919] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:33.051575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:33.063505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93eef-01b9-4ae4-b60b-9ca08f0d5d27 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:33.070082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:33.070763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.071022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.071293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] PATH_INFO: `/v3/projects/1b836974e7234c58ae54d4c86c7ef38c/users/fd3b906f4cad43e9a183d46dd3d6c559/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.073437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b836974e7234c58ae54d4c86c7ef38c, user_id=fd3b906f4cad43e9a183d46dd3d6c559, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:33.076067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:33.088098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 962/1920] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:33 2022] PUT /identity/v3/projects/1b836974e7234c58ae54d4c86c7ef38c/users/fd3b906f4cad43e9a183d46dd3d6c559/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:33.098413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.098700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.099036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.132546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] MFA Rules not processed for user `fd3b906f4cad43e9a183d46dd3d6c559`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:33.133861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:33.205170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 959/1921] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:33.216785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:33.218583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:33.275788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527600c8-1815-440e-85ae-e7d6b41fd88e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:33.279736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbce09-7674-422e-89a2-b7c2d4ed420b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:33.280342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbce09-7674-422e-89a2-b7c2d4ed420b service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.280616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbce09-7674-422e-89a2-b7c2d4ed420b service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.280884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbce09-7674-422e-89a2-b7c2d4ed420b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.290844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbce09-7674-422e-89a2-b7c2d4ed420b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:33.292246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbce09-7674-422e-89a2-b7c2d4ed420b service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:33.302001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 963/1922] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:33.555665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:33.740548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0838d29-93aa-4d34-a509-281b927ad5fa None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:33.752384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:33.753563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.754052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.754524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] PATH_INFO: `/v3/users/524e9883bfc14952a8c3c75d23240f9c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.758412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524e9883bfc14952a8c3c75d23240f9c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:33.762854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:33.806842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:33.874492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524e9883bfc14952a8c3c75d23240f9c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:33.894012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524e9883bfc14952a8c3c75d23240f9c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:33.894629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524e9883bfc14952a8c3c75d23240f9c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:33.909526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524e9883bfc14952a8c3c75d23240f9c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:33.931657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524e9883bfc14952a8c3c75d23240f9c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:33.946970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 960/1923] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:33 2022] DELETE /identity/v3/users/524e9883bfc14952a8c3c75d23240f9c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:33.947637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.947926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.948204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.982702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:33.985529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:34.062552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 964/1924] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:34.101672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:34.103415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:34.176673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e6c1-2f2e-427f-a5b0-158e06a431e1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:34.181911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:34.186997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.187648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.188303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.205830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:34.207864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:34.223066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 961/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:34.856250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:34.857905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:34.874636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8482d-b675-4104-8575-d005511bbbbf None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:34.879994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:34.880878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.881337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.881759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] PATH_INFO: `/v3/projects/987f77f64b0743dc811f20147e010f51` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.883046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=987f77f64b0743dc811f20147e010f51)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:34.885087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:34.966477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987f77f64b0743dc811f20147e010f51', 'request_id': 'req-1277b00a-3dce-459d-8ac6-c0a8742cb32b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:34.974302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987f77f64b0743dc811f20147e010f51', 'request_id': 'req-1277b00a-3dce-459d-8ac6-c0a8742cb32b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:34.986061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987f77f64b0743dc811f20147e010f51', 'request_id': 'req-1277b00a-3dce-459d-8ac6-c0a8742cb32b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:34.996159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:35.000937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] The token cache is being invalidate because project 987f77f64b0743dc811f20147e010f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:35.001432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.002590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.004561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 965/1926] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:34 2022] DELETE /identity/v3/projects/987f77f64b0743dc811f20147e010f51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:35.008854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:35.019709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dde07-12e5-420b-9535-9821931fd154 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:35.114224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:35.116255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:35.117661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:35.118174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] PATH_INFO: `/v3/users/fd3b906f4cad43e9a183d46dd3d6c559` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:35.119630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3b906f4cad43e9a183d46dd3d6c559)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:35.122496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:35.170197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:35.179867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3b906f4cad43e9a183d46dd3d6c559'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.190570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3b906f4cad43e9a183d46dd3d6c559'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.191203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3b906f4cad43e9a183d46dd3d6c559'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.205284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3b906f4cad43e9a183d46dd3d6c559'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.214046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-792ae309-8a4d-4746-8e74-db72cc888997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3b906f4cad43e9a183d46dd3d6c559'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.220533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 962/1927] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:35 2022] DELETE /identity/v3/users/fd3b906f4cad43e9a183d46dd3d6c559 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:35.530725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:35.535217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:35.551903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277b00a-3dce-459d-8ac6-c0a8742cb32b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:35.619628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:35.620509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:35.620973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:35.621595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] PATH_INFO: `/v3/projects/1b836974e7234c58ae54d4c86c7ef38c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:35.622857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b836974e7234c58ae54d4c86c7ef38c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:35.625189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:35.686986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b836974e7234c58ae54d4c86c7ef38c', 'request_id': 'req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.702138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b836974e7234c58ae54d4c86c7ef38c', 'request_id': 'req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.711160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b836974e7234c58ae54d4c86c7ef38c', 'request_id': 'req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.724360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] The token cache is being invalidate because project 1b836974e7234c58ae54d4c86c7ef38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:35.724788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.725485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59e6fbd2-bb51-4e9c-a6eb-7353b184f555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:35.727005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 966/1928] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:35 2022] DELETE /identity/v3/projects/1b836974e7234c58ae54d4c86c7ef38c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:35.732674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:35.733250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:35.733557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:35.755996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:35.757223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:35.845361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 963/1929] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:35.853661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:35.854196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:35.855442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:35.904392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:35.905829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:35.922553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 967/1930] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:35.926604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:35.938346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456772f4-d229-4d01-a34f-bc4d06840ee4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:35.943480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:35.944410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:35.944963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:35.945280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:35.945938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:35.946298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:35.955075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:35.967792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 964/1931] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:58:35.972304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:35.982310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda1f9-a8dd-4a87-80e5-c68b4194d966 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:35.987327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:35.987928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:35.988209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:35.988479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:35.989108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:35.991649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.021094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 968/1932] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:35 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:36.025207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.035595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afeff-f55a-4a9b-aa88-572abb691b68 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.112385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.113251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.113464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.113865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.114699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.117087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.145296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 965/1933] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:36 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:36.150192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.166605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f67a-d08e-42b8-a04b-d71df57c635c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.172562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.173394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.173794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.174312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.175016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.176921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.195668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.196889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 969/1934] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:36.212224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15c6cd-7f09-437d-b0c9-037e00f54b0e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.229814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5204-862f-41e6-9fd6-2b448a7aeabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.230449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5204-862f-41e6-9fd6-2b448a7aeabf admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.233401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5204-862f-41e6-9fd6-2b448a7aeabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.233921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5204-862f-41e6-9fd6-2b448a7aeabf admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.235351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc5204-862f-41e6-9fd6-2b448a7aeabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.237685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc5204-862f-41e6-9fd6-2b448a7aeabf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.250985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 966/1935] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:36.255330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.272202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f3e74-8ac7-4d21-b9aa-bf1fcabb46fa admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.277724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.279360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.280062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.280337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] PATH_INFO: `/v3/projects/7dd2ee7a9fef488aa2d24066a3a6e2d1/users/b806877b7f1241c1908c3064110f9b31/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.299812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd2ee7a9fef488aa2d24066a3a6e2d1, user_id=b806877b7f1241c1908c3064110f9b31, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.302677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.325319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 970/1936] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:36 2022] PUT /identity/v3/projects/7dd2ee7a9fef488aa2d24066a3a6e2d1/users/b806877b7f1241c1908c3064110f9b31/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:36.331457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.331708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.331997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.336981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.345036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.366846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] MFA Rules not processed for user `b806877b7f1241c1908c3064110f9b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:36.368464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.383868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:36.385557 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:36.448316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6830ce6-a28f-4190-94c7-4eee3a342b47 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.454329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.455583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.456058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.456722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] PATH_INFO: `/v3/users/0125edb273554fe086e622a119e84fd9` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.458051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0125edb273554fe086e622a119e84fd9)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.461107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.466172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 967/1937] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:36.470989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.482783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659c42-b55f-481a-8a7f-a80faca4719b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.487835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.488583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.488934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.489294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.490030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.492001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.522611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 968/1938] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:36.527100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.530955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0125edb273554fe086e622a119e84fd9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.532415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0125edb273554fe086e622a119e84fd9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.541866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0125edb273554fe086e622a119e84fd9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.554900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0125edb273554fe086e622a119e84fd9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.561693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7e78f5c3-c82f-46a4-abe6-c765c4010f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0125edb273554fe086e622a119e84fd9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.568582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 971/1939] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:36 2022] DELETE /identity/v3/users/0125edb273554fe086e622a119e84fd9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:36.572580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.572862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.573138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.593935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:36.595141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.600141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea8cdf-5cf5-4c88-9d81-a02d7cfeff73 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.653526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 972/1940] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:36.654572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.655813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.658746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.659371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.659656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.659930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.660550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.662556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.667366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573a3a9-aa18-4b8c-bbc4-6776b44fbaed None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.671935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.672556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.672827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.673091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] PATH_INFO: `/v3/users/1f680d92d8354527a9c70e6ebea3fe13` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.674248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f680d92d8354527a9c70e6ebea3fe13)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.676129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.687607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 969/1941] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:36 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:36.687607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.689252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.720575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:36.722160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:36.728492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f680d92d8354527a9c70e6ebea3fe13'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.729376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f680d92d8354527a9c70e6ebea3fe13'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.737856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f680d92d8354527a9c70e6ebea3fe13'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.750035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f680d92d8354527a9c70e6ebea3fe13'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.751305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022299f-0fe3-4f71-a891-22a821010652 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.754924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.756059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.756469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.756740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.757988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f680d92d8354527a9c70e6ebea3fe13'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:36.758621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.764010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 973/1942] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:36 2022] DELETE /identity/v3/users/1f680d92d8354527a9c70e6ebea3fe13 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:36.766101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.767767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.770469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.772468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085332fc-a744-4ba0-96df-091eab265330 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.782108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 970/1943] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:36.783271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.783641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.783916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.802855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:36.804214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.843347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679fa7b-ba7b-4b3f-b609-c657285e080a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.854394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.854394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.854678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.854763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.855414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.857190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.874033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 974/1944] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:36.879525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.892522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 971/1945] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:36.898931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c12f-955a-444a-9437-04deaa8c57f4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.903811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.906051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:36.907102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.907890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.908313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.908596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.909244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.911423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:36.924729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 975/1946] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:36.929422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:36.946076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6e1fd-b60b-4746-9b03-3d96508ad70b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:36.952171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8981b8b-7b06-44bc-846d-efb88cb32725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:36.953080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8981b8b-7b06-44bc-846d-efb88cb32725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:36.953700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8981b8b-7b06-44bc-846d-efb88cb32725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:36.954128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8981b8b-7b06-44bc-846d-efb88cb32725 admin admin] PATH_INFO: `/v3/projects/b90d31d6a7f640baa34bb527acdebf67/users/8d82ae1096414fba9d5bf42f12493b02/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:36.977347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8981b8b-7b06-44bc-846d-efb88cb32725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90d31d6a7f640baa34bb527acdebf67, user_id=8d82ae1096414fba9d5bf42f12493b02, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:36.982872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8981b8b-7b06-44bc-846d-efb88cb32725 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.003674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 976/1947] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:36 2022] PUT /identity/v3/projects/b90d31d6a7f640baa34bb527acdebf67/users/8d82ae1096414fba9d5bf42f12493b02/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:37.014617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.017076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.017389 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.023279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc47b29-47a4-4eaa-a75a-e3111b87b771 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.054141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] MFA Rules not processed for user `8d82ae1096414fba9d5bf42f12493b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:37.055989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:37.090212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.090802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.090886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.091136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.146252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 977/1948] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:37.151547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:37.157247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.170131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:37.180878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.182527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.194859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 972/1949] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:37.244367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd0433-ed17-4bc6-a7c2-9ffbeee8c9d0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.249742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.250298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.250689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.251187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.252021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.254129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.295520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.323105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 978/1950] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:37 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:37.331615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb913354-b7f5-4150-b5f0-595080d41da7 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.457390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.460591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.460957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.461330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.462704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.465240 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.503655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.529860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 973/1951] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:37 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:37.539354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e406-9671-422e-abb0-ccd527c01e5a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.559154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.561096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.561434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.561713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.562374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.564801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.589734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.590489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 979/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:37.607084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b7a2-6c52-472f-a657-5c9ab7149a24 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.616361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.617609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.618457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.619085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] PATH_INFO: `/v3/projects/17acc0f6456348dfba6aecf74c8ec5c2/users/654ba3ba86734672bd98d9dcbac81449/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.635852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.637983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:37.665061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ced76-89f2-4398-83ae-df68392e0d24 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.678751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17acc0f6456348dfba6aecf74c8ec5c2, user_id=654ba3ba86734672bd98d9dcbac81449, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.680612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.681988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.682647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.683071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] PATH_INFO: `/v3/projects/8eefde89ea944be4bbda74ba799646b8` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.684477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eefde89ea944be4bbda74ba799646b8)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.686747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.687499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.718707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 974/1953] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:37 2022] PUT /identity/v3/projects/17acc0f6456348dfba6aecf74c8ec5c2/users/654ba3ba86734672bd98d9dcbac81449/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:37.722632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.794139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eefde89ea944be4bbda74ba799646b8', 'request_id': 'req-3d2c564e-fe73-4fed-9476-3c213298cfbe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:37.810481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eefde89ea944be4bbda74ba799646b8', 'request_id': 'req-3d2c564e-fe73-4fed-9476-3c213298cfbe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:37.823439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eefde89ea944be4bbda74ba799646b8', 'request_id': 'req-3d2c564e-fe73-4fed-9476-3c213298cfbe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:37.840740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] The token cache is being invalidate because project 8eefde89ea944be4bbda74ba799646b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:37.841490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:37.842743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3d2c564e-fe73-4fed-9476-3c213298cfbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:37.846408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 980/1954] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:37 2022] DELETE /identity/v3/projects/8eefde89ea944be4bbda74ba799646b8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:37.851649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d591-30f1-44c9-86f0-5e613e9c1fc0 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.852156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d591-30f1-44c9-86f0-5e613e9c1fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.852264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f406f6-3f42-41d9-8624-188bbef33003 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:37.852802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d591-30f1-44c9-86f0-5e613e9c1fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.883959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c580d591-30f1-44c9-86f0-5e613e9c1fc0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:37.885994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c580d591-30f1-44c9-86f0-5e613e9c1fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:37.921617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:37.953546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:37.953947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:37.954324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:37.954488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:37.955842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:37.957649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:37.975486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 975/1955] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:37.979336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:37.982937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.002717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278310ec-b0bf-45b0-b350-170b448264c0 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.010335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 981/1956] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:38.011759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3df68-dc84-42fb-9d0a-a4c608f457ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.011976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.012330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.012561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.012707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3df68-dc84-42fb-9d0a-a4c608f457ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.013323 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3df68-dc84-42fb-9d0a-a4c608f457ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.013681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3df68-dc84-42fb-9d0a-a4c608f457ae admin admin] PATH_INFO: `/v3/projects/17acc0f6456348dfba6aecf74c8ec5c2/users/654ba3ba86734672bd98d9dcbac81449/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.015908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3df68-dc84-42fb-9d0a-a4c608f457ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=17acc0f6456348dfba6aecf74c8ec5c2, user_id=654ba3ba86734672bd98d9dcbac81449, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.019132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3df68-dc84-42fb-9d0a-a4c608f457ae admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.034768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 976/1957] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:37 2022] PUT /identity/v3/projects/17acc0f6456348dfba6aecf74c8ec5c2/users/654ba3ba86734672bd98d9dcbac81449/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:38.051598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.052845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.053208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.059155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:38.066418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:38.068541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.088325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] MFA Rules not processed for user `654ba3ba86734672bd98d9dcbac81449`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:38.089579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.149418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 982/1958] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:38.152122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.163406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fdd2c-51e4-4c54-8b5f-43aeba7a526c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.168271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.169517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.169804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.170078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.171088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:38.171705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.173850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.177762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 977/1959] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:38.195063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.198009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.200842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 983/1960] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:58:38.201844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.213996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304436d-17a4-45fd-a2ab-9a45586ac731 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.219176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.219798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.220078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.220353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.221129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.224540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.264486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 984/1961] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:38 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:38.265494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.267138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.277818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a41537-4514-4576-b809-e53ee8bfc0e2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.344635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.345199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.347164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.347445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.376829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d13bb2-12e3-4ba3-a45f-7ed3765608f3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.383065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.383713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.383997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.384275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] PATH_INFO: `/v3/projects/447bf0fc719643d096bb751e33552d85` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.385523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=447bf0fc719643d096bb751e33552d85)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.387573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.391351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:38.436276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.437681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.445615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447bf0fc719643d096bb751e33552d85', 'request_id': 'req-7b9c2e3f-ac67-4c55-957d-3565c3192d80'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.448263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 978/1962] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:38.448874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.454752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447bf0fc719643d096bb751e33552d85', 'request_id': 'req-7b9c2e3f-ac67-4c55-957d-3565c3192d80'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.466918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be308-e1fd-44a6-a157-d1763ccdbb15 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.467973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447bf0fc719643d096bb751e33552d85', 'request_id': 'req-7b9c2e3f-ac67-4c55-957d-3565c3192d80'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.480864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] The token cache is being invalidate because project 447bf0fc719643d096bb751e33552d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:38.481233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.481960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.487392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 985/1963] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:38 2022] DELETE /identity/v3/projects/447bf0fc719643d096bb751e33552d85 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:38.488301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.492283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.505584 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:38.545861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.546673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.547012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.547367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.548098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.550124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.590362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 979/1964] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:38 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:38.593208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.597506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.622050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c2e3f-ac67-4c55-957d-3565c3192d80 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.667330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.669735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.670106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.670466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] PATH_INFO: `/v3/users/6462003b4df34ba7921e8ac8dbda62e4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.672906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6462003b4df34ba7921e8ac8dbda62e4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.677579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.695756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb0aa-2bb9-46a7-a346-d5acdf3b7b27 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.704722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.705533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.706627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.706913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.715297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.770040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6462003b4df34ba7921e8ac8dbda62e4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.771558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6462003b4df34ba7921e8ac8dbda62e4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.786981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6462003b4df34ba7921e8ac8dbda62e4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.806537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.808135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.818423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6462003b4df34ba7921e8ac8dbda62e4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.827444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 980/1965] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:38.831545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.835917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6462003b4df34ba7921e8ac8dbda62e4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:38.839098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:38.853779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:38.857907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 986/1966] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:38 2022] DELETE /identity/v3/users/6462003b4df34ba7921e8ac8dbda62e4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:38.862334 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5e82-d24b-4fe7-a937-7a236a62934b service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:38.963405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:38.964287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:38.967917 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:38.968293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:38.969074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:38.972317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:38.989245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 981/1967] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:38.994083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:38.996682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.031344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268db4-7042-4092-9a3a-1287a1b2219e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.047829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a481ea-cb1f-40b7-8fbd-77a74cc1fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.048813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a481ea-cb1f-40b7-8fbd-77a74cc1fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.049111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a481ea-cb1f-40b7-8fbd-77a74cc1fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.049502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a481ea-cb1f-40b7-8fbd-77a74cc1fae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.050175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a481ea-cb1f-40b7-8fbd-77a74cc1fae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.056673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a481ea-cb1f-40b7-8fbd-77a74cc1fae4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.080291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 987/1968] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:39.085555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.117234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f96e2a-9a3f-4482-887a-e1ee3858f945 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.123323 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.124342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.124754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.125127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] PATH_INFO: `/v3/projects/8cdefa64233f46d2aa6affa9f910439a/users/be5f8d7090c2475aa17055bd96066897/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.148269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdefa64233f46d2aa6affa9f910439a, user_id=be5f8d7090c2475aa17055bd96066897, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.152156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.195723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 982/1969] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:39 2022] PUT /identity/v3/projects/8cdefa64233f46d2aa6affa9f910439a/users/be5f8d7090c2475aa17055bd96066897/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:39.207264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.207673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.209292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.266701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] MFA Rules not processed for user `be5f8d7090c2475aa17055bd96066897`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:39.268836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.353307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.358074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.371604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:39.386674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 988/1970] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:39.396780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.398382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.488283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278ae2-840c-4c2f-9859-a89266cd8c45 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.494003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.494650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.494935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.495963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] PATH_INFO: `/v3/projects/bb222354800842e9920aa661453caf13` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.497490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb222354800842e9920aa661453caf13)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.499745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.514776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97678dd-f56e-47de-98a6-10ff1d67eb4f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.518751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ae25-bf01-4f67-9130-5620c007fb33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.519459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ae25-bf01-4f67-9130-5620c007fb33 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.519886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ae25-bf01-4f67-9130-5620c007fb33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.520234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ae25-bf01-4f67-9130-5620c007fb33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.544132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ae25-bf01-4f67-9130-5620c007fb33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.546093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ae25-bf01-4f67-9130-5620c007fb33 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.563670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 989/1971] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:39.581490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb222354800842e9920aa661453caf13', 'request_id': 'req-89a4b4d6-1698-474c-aacc-25f67c185477'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:39.588263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb222354800842e9920aa661453caf13', 'request_id': 'req-89a4b4d6-1698-474c-aacc-25f67c185477'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:39.599535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb222354800842e9920aa661453caf13', 'request_id': 'req-89a4b4d6-1698-474c-aacc-25f67c185477'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:39.611965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] The token cache is being invalidate because project bb222354800842e9920aa661453caf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:39.612361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:39.613099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-89a4b4d6-1698-474c-aacc-25f67c185477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:39.615604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 983/1972] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:39 2022] DELETE /identity/v3/projects/bb222354800842e9920aa661453caf13 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:39.622121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.623014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.623449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.644224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:39.645473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.712834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 990/1973] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:39.722313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.722719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.723021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.755988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:39.762756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:39.764162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.777709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 984/1974] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:39.780159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.794840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db73b1e-22a4-4482-a154-5d7c70735304 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.800124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.800972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.800972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.801276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.802524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:39.802830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.804416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.818563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 991/1975] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:39.823438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.834483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f25b5-8e6d-4a8a-a03b-f26000966576 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.841457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.851845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.852138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.852414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.853078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.855042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.897134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 985/1976] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:39.901438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.913064 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47e69-6d9c-4c74-bc73-61652644b19b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.972915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.973555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.974380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.974653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.975264 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.977152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.996461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 992/1977] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:40.000819 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.011086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4ff5-1d9d-4697-80d2-5b389fc1cf8d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.015578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.016171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.016468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.016714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.017383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.019013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.030084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 986/1978] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:40.033914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.044442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cabca-b148-4d29-bff9-30aae71e405d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.049041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45824-a155-4f87-b3ed-a70cd3d5507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.049675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45824-a155-4f87-b3ed-a70cd3d5507e admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.049962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45824-a155-4f87-b3ed-a70cd3d5507e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.050238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45824-a155-4f87-b3ed-a70cd3d5507e admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.050868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45824-a155-4f87-b3ed-a70cd3d5507e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.052450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45824-a155-4f87-b3ed-a70cd3d5507e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.063509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 993/1979] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:40.067582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.077724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917e8ff-ee4b-454e-a5a1-b611867438d0 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.082731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.083896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.084179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.084463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] PATH_INFO: `/v3/projects/4535e08d5abe4feca958345aed26199f/users/d410ebf859d24d0985a05b2d9678f995/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.100530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4535e08d5abe4feca958345aed26199f, user_id=d410ebf859d24d0985a05b2d9678f995, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.103251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.119923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 987/1980] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:40 2022] PUT /identity/v3/projects/4535e08d5abe4feca958345aed26199f/users/d410ebf859d24d0985a05b2d9678f995/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:40.138919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.139268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.139478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.165425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:40.182270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] MFA Rules not processed for user `d410ebf859d24d0985a05b2d9678f995`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:40.184440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:40.286380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 994/1981] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:40.294380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.296920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:40.392643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126e437-7aaf-4f6b-819d-e4a66b98bd78 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.398613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fd86f-4e12-4e70-be96-8adb05441b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.399707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd86f-4e12-4e70-be96-8adb05441b03 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.400313 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd86f-4e12-4e70-be96-8adb05441b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.400593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd86f-4e12-4e70-be96-8adb05441b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.417789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fd86f-4e12-4e70-be96-8adb05441b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.419520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fd86f-4e12-4e70-be96-8adb05441b03 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.433071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 988/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:40.456792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.578905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3058ade-fdf8-46d6-8fe7-901e293d3956 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.595804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.596465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.596748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.597062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] PATH_INFO: `/v3/users/d410ebf859d24d0985a05b2d9678f995` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.598269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d410ebf859d24d0985a05b2d9678f995)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.600236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.684164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd410ebf859d24d0985a05b2d9678f995'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:40.685144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd410ebf859d24d0985a05b2d9678f995'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:40.719907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd410ebf859d24d0985a05b2d9678f995'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:40.742924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd410ebf859d24d0985a05b2d9678f995'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:40.753251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd410ebf859d24d0985a05b2d9678f995'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:40.760957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 995/1983] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:40 2022] DELETE /identity/v3/users/d410ebf859d24d0985a05b2d9678f995 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:40.765287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.765594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.765874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.794046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:40.795597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:40.872557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 989/1984] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:40.882862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.885858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:40.910134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:40.998945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69513b68-5c6a-40aa-8a1b-dba031c6d324 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:41.005185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b674-c161-41ef-b3b1-77af1b7e6519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:41.006111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b674-c161-41ef-b3b1-77af1b7e6519 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.006788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b674-c161-41ef-b3b1-77af1b7e6519 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.007292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b674-c161-41ef-b3b1-77af1b7e6519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.048426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1b674-c161-41ef-b3b1-77af1b7e6519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:41.050159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1b674-c161-41ef-b3b1-77af1b7e6519 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:41.063542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 996/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:41.489931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:41.491516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:41.514115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72448f-19fd-46a1-a64c-411228193b50 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:41.528861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:41.529769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.530054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.530329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] PATH_INFO: `/v3/projects/4535e08d5abe4feca958345aed26199f` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.533368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4535e08d5abe4feca958345aed26199f)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:41.535517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:41.594386 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:41.604422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4535e08d5abe4feca958345aed26199f', 'request_id': 'req-442e2283-14ff-4ca1-83fe-efd7f79b6d84'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:41.611557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4535e08d5abe4feca958345aed26199f', 'request_id': 'req-442e2283-14ff-4ca1-83fe-efd7f79b6d84'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:41.620554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4535e08d5abe4feca958345aed26199f', 'request_id': 'req-442e2283-14ff-4ca1-83fe-efd7f79b6d84'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:41.638004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] The token cache is being invalidate because project 4535e08d5abe4feca958345aed26199f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:41.638372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:41.639113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-442e2283-14ff-4ca1-83fe-efd7f79b6d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:41.643985 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 990/1986] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:41 2022] DELETE /identity/v3/projects/4535e08d5abe4feca958345aed26199f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:41.646692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.647049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.647419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.671714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:41.673160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:41.755734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 997/1987] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:41.764577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.765415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.765720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.800586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:41.804009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:41.824451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 991/1988] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:41.830973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:41.846652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf3f59-90f0-45a7-80f4-ea80dde0bbdc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:41.851914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:41.852603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.852954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.853324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.854041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:41.854406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:41.856073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:41.870851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 998/1989] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:41.875204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:41.886044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cead9-fa19-4924-809f-cdc47e7b972e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:41.890893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:41.891505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.891785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.892058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.892689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:41.894694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:41.930951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 992/1990] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:41 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:41.935117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:41.946093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f50341-cb87-4269-866a-3125703e9f7a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.022611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.023310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.023656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.024270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.024722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.027098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.049202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 999/1991] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:41 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:42.053489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.064946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418d17-3b81-4d8b-82ff-602590c24115 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.084302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.084936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.085223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.089612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.090863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.091959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.110002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 993/1992] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:42.114975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.125982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c740e0-9059-43db-9559-74e46c14fb2a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.131291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf849a19-22d3-4935-8e6f-1b79317418f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.131906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849a19-22d3-4935-8e6f-1b79317418f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.132184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849a19-22d3-4935-8e6f-1b79317418f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.132458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849a19-22d3-4935-8e6f-1b79317418f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.133111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf849a19-22d3-4935-8e6f-1b79317418f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.134970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf849a19-22d3-4935-8e6f-1b79317418f4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.146278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1000/1993] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:42.150505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.167064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6e9a9-b626-4f0f-9693-9bf72f5412bf admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.172315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.172871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.173153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.173468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] PATH_INFO: `/v3/projects/c684aa2881cb4b9195bfbd4a48ff18de/users/af196de59db34163a8b2d9f724f9161e/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.202099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c684aa2881cb4b9195bfbd4a48ff18de, user_id=af196de59db34163a8b2d9f724f9161e, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.204746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.237145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 994/1994] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:42 2022] PUT /identity/v3/projects/c684aa2881cb4b9195bfbd4a48ff18de/users/af196de59db34163a8b2d9f724f9161e/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:42.248928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.249620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.249620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.285031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] MFA Rules not processed for user `af196de59db34163a8b2d9f724f9161e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:42.286866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:42.306105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:42.323398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.325512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:42.382624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1001/1995] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:42.394093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.395453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:42.397377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d08dd-6692-4a51-bcbb-19c88812ac10 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.402326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.402969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.403250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.403554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] PATH_INFO: `/v3/users/b806877b7f1241c1908c3064110f9b31` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.404701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b806877b7f1241c1908c3064110f9b31)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.406808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.464898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8429db-d208-41f6-8f5a-aae5455d9f62 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.466076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b806877b7f1241c1908c3064110f9b31'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:42.472818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5739-10a2-40ae-9f44-60adf298a0d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.473581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5739-10a2-40ae-9f44-60adf298a0d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.474735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5739-10a2-40ae-9f44-60adf298a0d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.475404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5739-10a2-40ae-9f44-60adf298a0d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.476453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b806877b7f1241c1908c3064110f9b31'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:42.477101 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b806877b7f1241c1908c3064110f9b31'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:42.485543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5739-10a2-40ae-9f44-60adf298a0d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.486987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5739-10a2-40ae-9f44-60adf298a0d7 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.490370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:42.492644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b806877b7f1241c1908c3064110f9b31'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:42.498898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1002/1996] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:42.500887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b806877b7f1241c1908c3064110f9b31'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:42.512037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 995/1997] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:42 2022] DELETE /identity/v3/users/b806877b7f1241c1908c3064110f9b31 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:42.513658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.513950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.514231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.533964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:42.535244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:42.613685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1003/1998] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:42.624709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.626198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:42.705612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aeb41-8775-4c92-9779-f8bab47e2bb3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.709940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298258-192b-49c0-9364-58c1b14f1f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.710517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298258-192b-49c0-9364-58c1b14f1f84 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.710804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298258-192b-49c0-9364-58c1b14f1f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.711078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298258-192b-49c0-9364-58c1b14f1f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.722353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298258-192b-49c0-9364-58c1b14f1f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.724330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298258-192b-49c0-9364-58c1b14f1f84 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.737460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 996/1999] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:42.865701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:42.869018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:42.888086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fcc18-a4f3-468a-be82-cf95e625702a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:42.896652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:42.897633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:42.898082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:42.898559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] PATH_INFO: `/v3/users/be5f8d7090c2475aa17055bd96066897` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:42.900775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5f8d7090c2475aa17055bd96066897)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:42.904176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:42.979709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5f8d7090c2475aa17055bd96066897'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:42.980453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5f8d7090c2475aa17055bd96066897'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.001019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5f8d7090c2475aa17055bd96066897'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.002753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:43.031881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5f8d7090c2475aa17055bd96066897'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.045142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5f8d7090c2475aa17055bd96066897'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.058164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1004/2000] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:42 2022] DELETE /identity/v3/users/be5f8d7090c2475aa17055bd96066897 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:43.062444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:43.063006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:43.063495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:43.096241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:43.101713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:43.106058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:43.107760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:43.224195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 997/2001] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:43.225825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c1a3-e781-45b8-b74c-b89daa736cc7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:43.232503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:43.232827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:43.233928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:43.234358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:43.234543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:43.234892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] PATH_INFO: `/v3/projects/7dd2ee7a9fef488aa2d24066a3a6e2d1` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:43.236449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd2ee7a9fef488aa2d24066a3a6e2d1)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:43.239425 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:43.305830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd2ee7a9fef488aa2d24066a3a6e2d1', 'request_id': 'req-315da12d-c75d-4825-a998-e24952f5a5d6'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.314928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd2ee7a9fef488aa2d24066a3a6e2d1', 'request_id': 'req-315da12d-c75d-4825-a998-e24952f5a5d6'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.316859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a8077-0a9e-4cd5-8b4e-66056ad7e9c4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:43.326242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd2ee7a9fef488aa2d24066a3a6e2d1', 'request_id': 'req-315da12d-c75d-4825-a998-e24952f5a5d6'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.352196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] The token cache is being invalidate because project 7dd2ee7a9fef488aa2d24066a3a6e2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:43.352495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.353692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.356865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1005/2002] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:43 2022] DELETE /identity/v3/projects/7dd2ee7a9fef488aa2d24066a3a6e2d1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:43.374164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:43.375955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:43.413927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:43.433045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:43.433721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:43.434090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:43.434404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:43.436406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:43.462789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da12d-c75d-4825-a998-e24952f5a5d6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:43.468384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:43.469063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:43.469437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:43.469699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] PATH_INFO: `/v3/users/8d82ae1096414fba9d5bf42f12493b02` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:43.470901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d82ae1096414fba9d5bf42f12493b02)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:43.473032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:43.476063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:43.517131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:43.518821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:43.544368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 998/2003] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:43.555698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d82ae1096414fba9d5bf42f12493b02'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.556408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d82ae1096414fba9d5bf42f12493b02'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.569317 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d82ae1096414fba9d5bf42f12493b02'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.588334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d82ae1096414fba9d5bf42f12493b02'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.597339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d82ae1096414fba9d5bf42f12493b02'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:43.623758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1006/2004] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:43 2022] DELETE /identity/v3/users/8d82ae1096414fba9d5bf42f12493b02 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:43.934303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:43.936421 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:43.961018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09142e-7463-4223-a6cc-2eadbaeac61d service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.014333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.016541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:44.082970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.083976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.084507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.084976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] PATH_INFO: `/v3/projects/8cdefa64233f46d2aa6affa9f910439a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.086418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdefa64233f46d2aa6affa9f910439a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.088542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.129645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018424d-2890-4500-8a75-c6d5daccaba6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.140533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.141795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.142456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.142930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] PATH_INFO: `/v3/projects/b90d31d6a7f640baa34bb527acdebf67` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.144559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90d31d6a7f640baa34bb527acdebf67)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.146955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.155787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdefa64233f46d2aa6affa9f910439a', 'request_id': 'req-78081c90-1394-4ff2-b9ce-28a0a17c4440'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.163308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdefa64233f46d2aa6affa9f910439a', 'request_id': 'req-78081c90-1394-4ff2-b9ce-28a0a17c4440'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.173194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdefa64233f46d2aa6affa9f910439a', 'request_id': 'req-78081c90-1394-4ff2-b9ce-28a0a17c4440'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.186270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] The token cache is being invalidate because project 8cdefa64233f46d2aa6affa9f910439a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:44.186497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.187281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-78081c90-1394-4ff2-b9ce-28a0a17c4440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.188979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 999/2005] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:43 2022] DELETE /identity/v3/projects/8cdefa64233f46d2aa6affa9f910439a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:44.194407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee35f-cea1-4104-95a5-aefce4a05934 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.194693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee35f-cea1-4104-95a5-aefce4a05934 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.194966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee35f-cea1-4104-95a5-aefce4a05934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.218079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4bcee35f-cea1-4104-95a5-aefce4a05934 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:44.219314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4bcee35f-cea1-4104-95a5-aefce4a05934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:44.222142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90d31d6a7f640baa34bb527acdebf67', 'request_id': 'req-ce952383-22d7-47ea-857b-355c41241f4f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.230797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90d31d6a7f640baa34bb527acdebf67', 'request_id': 'req-ce952383-22d7-47ea-857b-355c41241f4f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.238696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90d31d6a7f640baa34bb527acdebf67', 'request_id': 'req-ce952383-22d7-47ea-857b-355c41241f4f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.243153 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:44.255672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] The token cache is being invalidate because project b90d31d6a7f640baa34bb527acdebf67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:44.256107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.256746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.259464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1007/2006] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:44 2022] DELETE /identity/v3/projects/b90d31d6a7f640baa34bb527acdebf67 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:44.264286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.266318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:44.283091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:44.310690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1000/2007] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:44.320833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.321210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.321653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.356734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952383-22d7-47ea-857b-355c41241f4f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.360991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:44.361510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.362477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.362477 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.362701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] PATH_INFO: `/v3/users/654ba3ba86734672bd98d9dcbac81449` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.362856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:44.364123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654ba3ba86734672bd98d9dcbac81449)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.366418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.375244 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1001/2008] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:44.379363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.391848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542076b-0c2f-4f4a-b9d6-00130b12be92 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.401880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.402602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.402913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.403199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.403857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:44.404202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.406024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.429427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1002/2009] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:44.430495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.433986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654ba3ba86734672bd98d9dcbac81449'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.434796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654ba3ba86734672bd98d9dcbac81449'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.443759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16ac3f-6490-4ba9-b539-0ec937a2dbc2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.445422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654ba3ba86734672bd98d9dcbac81449'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.455067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.455794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.456076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.456348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.456975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.459712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.474142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654ba3ba86734672bd98d9dcbac81449'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.483685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654ba3ba86734672bd98d9dcbac81449'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:44.491685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1008/2010] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:44 2022] DELETE /identity/v3/users/654ba3ba86734672bd98d9dcbac81449 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:44.501180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1003/2011] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:44 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:44.505892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.507599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:44.592343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3933a9-9f16-4b4f-9c9c-5cbef06978c2 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.643988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:44.695593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.696548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.697762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.698226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.699062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.701130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.732233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1009/2012] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:44 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:44.736389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.747867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95b72e-a000-46a1-b07a-4a7db05818c9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.752670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.753335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.753614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.753883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.754526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.756185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.767309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1004/2013] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:44.771801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.782540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355aac88-901e-47c4-91f5-26ecf2656062 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.790745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.791500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.791846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.792189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.792962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.795485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.809388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1010/2014] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:44.813533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.825065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb27301-c01b-4503-95ba-3df40139088b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.831025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282a6c-1b64-4049-8e65-b3048ce06fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:44.831704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282a6c-1b64-4049-8e65-b3048ce06fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.831984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282a6c-1b64-4049-8e65-b3048ce06fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.832259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282a6c-1b64-4049-8e65-b3048ce06fe0 admin admin] PATH_INFO: `/v3/projects/845d51abb49b42a399a07fef255643f4/users/385315f03e914b94bf0df4f3488d9e0a/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.855060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a282a6c-1b64-4049-8e65-b3048ce06fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845d51abb49b42a399a07fef255643f4, user_id=385315f03e914b94bf0df4f3488d9e0a, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:44.858189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a282a6c-1b64-4049-8e65-b3048ce06fe0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:44.890364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:44.896489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1005/2015] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:44 2022] PUT /identity/v3/projects/845d51abb49b42a399a07fef255643f4/users/385315f03e914b94bf0df4f3488d9e0a/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:44.913298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:44.915001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:44.915367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:44.915524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:44.941840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea97c93-fcfb-4f9e-9a88-05ce413b9333 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:44.956593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] MFA Rules not processed for user `385315f03e914b94bf0df4f3488d9e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:44.958008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.028137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.029642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.030020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.030595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] PATH_INFO: `/v3/projects/17acc0f6456348dfba6aecf74c8ec5c2` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.033573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17acc0f6456348dfba6aecf74c8ec5c2)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.033799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.046167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1006/2016] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:45.050444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.069199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebd04f-811e-410e-ad9e-5e1c97ada734 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.077459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.078513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.079010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.080232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.081287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.083878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.103386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17acc0f6456348dfba6aecf74c8ec5c2', 'request_id': 'req-00c05325-3d97-49fc-803d-9db8f31f6c4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.110324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17acc0f6456348dfba6aecf74c8ec5c2', 'request_id': 'req-00c05325-3d97-49fc-803d-9db8f31f6c4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.124074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1007/2017] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:45.127935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.129480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17acc0f6456348dfba6aecf74c8ec5c2', 'request_id': 'req-00c05325-3d97-49fc-803d-9db8f31f6c4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.149177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] The token cache is being invalidate because project 17acc0f6456348dfba6aecf74c8ec5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:45.149698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.150742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-00c05325-3d97-49fc-803d-9db8f31f6c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.152681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1011/2018] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:44 2022] DELETE /identity/v3/projects/17acc0f6456348dfba6aecf74c8ec5c2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:45.158674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.158969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.159250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.172257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:45.189280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:45.190802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.242159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db8918-a744-4512-8fb8-7321d9c2d0db admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.248378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.248987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.249638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.249955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.250570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.252486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.262513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:45.278213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1008/2019] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:45.279388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.282523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.289340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1012/2020] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:45.289340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.295588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.299481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd9696-b55a-4161-99f3-a3f68465bbbe admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.304438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.305095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.305416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.305694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] PATH_INFO: `/v3/users/af196de59db34163a8b2d9f724f9161e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.306896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af196de59db34163a8b2d9f724f9161e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.308837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.310582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b197-c7e4-4acd-b2a9-f33c8452dadb None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.316397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84963-7e2a-45c6-a8bd-ef87d2412fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.317034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84963-7e2a-45c6-a8bd-ef87d2412fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.317376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84963-7e2a-45c6-a8bd-ef87d2412fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.317650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84963-7e2a-45c6-a8bd-ef87d2412fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.318452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84963-7e2a-45c6-a8bd-ef87d2412fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.320073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84963-7e2a-45c6-a8bd-ef87d2412fd3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.336217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1013/2021] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:45.336217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.336217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.336217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.362398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:45.363676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.372418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1014/2022] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:45.375605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af196de59db34163a8b2d9f724f9161e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.376211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.385942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52d1ee-b2c3-4c19-afbf-134730b7d0c0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.386863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af196de59db34163a8b2d9f724f9161e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.387854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af196de59db34163a8b2d9f724f9161e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.392494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.393117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.393435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.393743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.394355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.396619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.403719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af196de59db34163a8b2d9f724f9161e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.408034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1015/2023] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:45.408780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.412930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.416437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af196de59db34163a8b2d9f724f9161e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:45.423595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1009/2024] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:45 2022] DELETE /identity/v3/users/af196de59db34163a8b2d9f724f9161e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:45.424681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.426703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.429224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed113f-51dc-4aac-b40b-1209bf900139 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.494460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.495078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.495369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.495640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.496290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:45.496631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.498275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315f33-03b7-4641-8319-50ae3adeffe4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.499292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f84ee6-4171-4c76-bfe2-0f055924a09d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.506370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.506777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.507129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.507477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] PATH_INFO: `/v3/projects/60e31e467f0049f4b408fb8bd9a3d7d6/users/607a7701e22a4158a6e75f2d6b542a3b/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.512878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1016/2025] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:45.514673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.514968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.515248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.529802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e31e467f0049f4b408fb8bd9a3d7d6, user_id=607a7701e22a4158a6e75f2d6b542a3b, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.532791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.540988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:45.542218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.550500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:45.555685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1017/2026] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:45.555685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.569352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1010/2027] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:45 2022] PUT /identity/v3/projects/60e31e467f0049f4b408fb8bd9a3d7d6/users/607a7701e22a4158a6e75f2d6b542a3b/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:45.571377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.571752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888501-60c2-4bda-9f62-bab8e89f1cc1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.573930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.659556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889932a-95a4-4d28-a7bf-b34c198ceda7 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.664438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.665133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.665449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.665728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.670631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a148810-8ca8-49d3-bc09-24c283856834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.671257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148810-8ca8-49d3-bc09-24c283856834 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.671523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148810-8ca8-49d3-bc09-24c283856834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.671800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148810-8ca8-49d3-bc09-24c283856834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.672426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a148810-8ca8-49d3-bc09-24c283856834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.674538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a148810-8ca8-49d3-bc09-24c283856834 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.703602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1018/2028] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/projects => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:45.704868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.705152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.705458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.736035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] MFA Rules not processed for user `607a7701e22a4158a6e75f2d6b542a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:45.737283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:45.741308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.743245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.758216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1011/2029] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:45.759701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.769376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:45.775392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c67e26-e34e-4868-8351-458b5a5f5e3f service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.864690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.869358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.869511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1019/2030] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:45.869610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.869610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.869610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.869953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.870912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.894258 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0fb90-0810-45c9-b4c4-618f63600580 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.898496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1012/2031] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/users => generated 280 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:45.902521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.903055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.903444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.903948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.904229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.904953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.907289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.924159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4c8ce-993b-4746-a913-73cbe8ac240f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:45.934903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:45.936045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:45.937055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:45.937370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:45.938669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:45.940972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:45.950517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1020/2032] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:45.954842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.955756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1013/2033] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:45.959741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:45.973154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086e1e8-9ac3-4064-b806-11a20582adf7 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.005464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:46.049932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c518b-82f0-467b-b3da-8418b9f917ca admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.057344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.058287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.058576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.058852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.061102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.065343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.075742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.076762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.077291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.077709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.078568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.080631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.099980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1014/2034] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:46.103394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1021/2035] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:45 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:46.110219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.110413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.121804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375c5bd-fec1-4fcc-961f-772b8304f32b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.125135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240f41-c6f9-4791-8509-0e0ee2f3ccf3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.127455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6ab1-6490-41d2-906d-2605b5b5ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.128329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6ab1-6490-41d2-906d-2605b5b5ad62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.128753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6ab1-6490-41d2-906d-2605b5b5ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.129169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6ab1-6490-41d2-906d-2605b5b5ad62 admin admin] PATH_INFO: `/v3/projects/8377e2dc620e4bbab90053dc74e54caf/users/bdb42a1e4866408e82ea12822b054a86/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.130732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.131353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.131636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.132047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.133773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.135720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.148145 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6ab1-6490-41d2-906d-2605b5b5ad62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8377e2dc620e4bbab90053dc74e54caf, user_id=bdb42a1e4866408e82ea12822b054a86, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.153295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1022/2036] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:46.153450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6ab1-6490-41d2-906d-2605b5b5ad62 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.157018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.174550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c1e9e-90b8-418c-b406-c117a84a4a8d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.196232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.198050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.198239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.198478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] PATH_INFO: `/v3/projects/d44fbba6f08d483898d5aa1f8b150d8b/users/7fbe75f38f654eb1b096f148399bc1ef/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.205665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1015/2037] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:46 2022] PUT /identity/v3/projects/8377e2dc620e4bbab90053dc74e54caf/users/bdb42a1e4866408e82ea12822b054a86/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:46.216376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.217103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.217103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.241846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44fbba6f08d483898d5aa1f8b150d8b, user_id=7fbe75f38f654eb1b096f148399bc1ef, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.251451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.263861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] MFA Rules not processed for user `bdb42a1e4866408e82ea12822b054a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:46.265357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.289149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1023/2038] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:46 2022] PUT /identity/v3/projects/d44fbba6f08d483898d5aa1f8b150d8b/users/7fbe75f38f654eb1b096f148399bc1ef/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:46.293328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.298165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.365419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1016/2039] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:46.367022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.380463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:46.414326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7cc7a-8de0-4fdd-a9f5-9c092f11798c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.420788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.422073 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.422355 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.422625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] PATH_INFO: `/v3/projects/c684aa2881cb4b9195bfbd4a48ff18de` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.423780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c684aa2881cb4b9195bfbd4a48ff18de)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.426623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.490218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c684aa2881cb4b9195bfbd4a48ff18de', 'request_id': 'req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:46.500600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c684aa2881cb4b9195bfbd4a48ff18de', 'request_id': 'req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:46.503392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efab7-c539-451e-a190-48688fa5ac47 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.512661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c684aa2881cb4b9195bfbd4a48ff18de', 'request_id': 'req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:46.528760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] The token cache is being invalidate because project c684aa2881cb4b9195bfbd4a48ff18de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:46.529401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:46.532087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:46.532384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1024/2040] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:46 2022] DELETE /identity/v3/projects/c684aa2881cb4b9195bfbd4a48ff18de => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:46.543514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.573701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.597410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:46.660692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.661689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.662113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.662572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.664252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.680062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.720287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1017/2041] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:46.724875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.731606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.776073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f672cb4-d7b4-4ced-96c5-6b84cd858530 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.790284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334e38-d27a-4b7f-a4dd-721150308ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.791309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334e38-d27a-4b7f-a4dd-721150308ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.791742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334e38-d27a-4b7f-a4dd-721150308ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.792193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa91f-b2f4-46e8-b216-cc71ebbf9b66 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.792439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334e38-d27a-4b7f-a4dd-721150308ec6 admin admin] PATH_INFO: `/v3/projects/d44fbba6f08d483898d5aa1f8b150d8b/users/7fbe75f38f654eb1b096f148399bc1ef/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.795496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6334e38-d27a-4b7f-a4dd-721150308ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44fbba6f08d483898d5aa1f8b150d8b, user_id=7fbe75f38f654eb1b096f148399bc1ef, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.799901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6334e38-d27a-4b7f-a4dd-721150308ec6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.808282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:46.808909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.809189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.809563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.811622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.822010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1018/2042] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:46 2022] PUT /identity/v3/projects/d44fbba6f08d483898d5aa1f8b150d8b/users/7fbe75f38f654eb1b096f148399bc1ef/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:46.835194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:46.835522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:46.836691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:46.872681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] MFA Rules not processed for user `7fbe75f38f654eb1b096f148399bc1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:46.874305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.913714 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:46.915229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:46.927564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1025/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:46.945936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.947447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:46.965123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1019/2044] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:46.970510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f1e7a-34a4-4adf-8601-4f5436ce95f2 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:46.976683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:46.979855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:47.018502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:47.047145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:47.047914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:47.048208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:47.048535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] PATH_INFO: `/v3/users/bdb42a1e4866408e82ea12822b054a86` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:47.049839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb42a1e4866408e82ea12822b054a86)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:47.052380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:47.059048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cce01-7e95-4d78-8cc8-cd472e72007b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:47.062805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:47.063416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:47.063698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:47.063968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:47.066211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:47.108406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb42a1e4866408e82ea12822b054a86'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:47.109114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb42a1e4866408e82ea12822b054a86'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:47.118067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb42a1e4866408e82ea12822b054a86'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:47.132501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb42a1e4866408e82ea12822b054a86'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:47.135919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:47.137506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:47.143568 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:47.145504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-6340c8e1-be8e-45eb-b09b-9691a9aeb8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb42a1e4866408e82ea12822b054a86'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:47.153360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1026/2045] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:46 2022] DELETE /identity/v3/users/bdb42a1e4866408e82ea12822b054a86 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:47.157561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1020/2046] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:58:47.158434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:47.158730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:47.159090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:47.179387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:47.180604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:47.258775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1027/2047] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:47.265251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:47.266760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:47.364484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c12fe1-3d2e-480b-b65b-1e0da08936d0 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:47.435715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:47.436355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:47.436677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:47.437111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:47.448451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:47.449936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:47.469307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1021/2048] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:47.989514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:47.991029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:48.012934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c0385-00d8-436d-b18a-cf092a0a038e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:48.051753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:48.052422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:48.052998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:48.052998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] PATH_INFO: `/v3/projects/8377e2dc620e4bbab90053dc74e54caf` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:48.059723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8377e2dc620e4bbab90053dc74e54caf)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:48.065467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:48.171459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8377e2dc620e4bbab90053dc74e54caf', 'request_id': 'req-36f33098-92f9-4dbb-b988-fa8bb2d97884'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:48.174621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:48.181861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8377e2dc620e4bbab90053dc74e54caf', 'request_id': 'req-36f33098-92f9-4dbb-b988-fa8bb2d97884'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:48.196748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8377e2dc620e4bbab90053dc74e54caf', 'request_id': 'req-36f33098-92f9-4dbb-b988-fa8bb2d97884'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:48.210506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] The token cache is being invalidate because project 8377e2dc620e4bbab90053dc74e54caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:48.211068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:48.212054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:48.214136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1028/2049] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:47 2022] DELETE /identity/v3/projects/8377e2dc620e4bbab90053dc74e54caf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:48.807294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:48.808861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:48.883372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293fa4-43f8-41b9-a1b8-f692fc966c0e service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:48.960167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:48.960792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:48.961074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:48.961390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:48.963351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:49.003619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:49.040199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:49.041987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:49.057657 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1022/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:49.882509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:49.883887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:49.895770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f33098-92f9-4dbb-b988-fa8bb2d97884 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:49.899348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:49.899971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:49.900248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:49.900520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:49.902456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:49.964384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:49.965835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da29ff-222f-4ae0-a6d3-d27542b620e6 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:49.975577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1029/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:53.879210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:53.881103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:53.945130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d726f-414c-466d-b69c-32aea115a723 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:53.949680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:53.950332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:53.950608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:53.950880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] PATH_INFO: `/v3/users/385315f03e914b94bf0df4f3488d9e0a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:53.952004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385315f03e914b94bf0df4f3488d9e0a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:53.953980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:53.998611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385315f03e914b94bf0df4f3488d9e0a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.006304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385315f03e914b94bf0df4f3488d9e0a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.006977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385315f03e914b94bf0df4f3488d9e0a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.019452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385315f03e914b94bf0df4f3488d9e0a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.027126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385315f03e914b94bf0df4f3488d9e0a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.032855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1023/2052] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:53 2022] DELETE /identity/v3/users/385315f03e914b94bf0df4f3488d9e0a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:54.037436 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:54.037893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:54.038007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:54.056069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:54.057333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:54.115672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1030/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:54.125411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:54.126827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:54.198871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:54.203653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be1cf-85c7-4608-9100-af62cc22f188 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:54.211104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:54.211939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:54.212414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:54.212860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:54.233035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:54.234505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:54.245785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1024/2054] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:54.722224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:54.723778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:54.737353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d552ab-ff34-444b-9945-049f2aa1a91c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:54.742741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:54.744178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:54.744458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:54.744732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] PATH_INFO: `/v3/projects/845d51abb49b42a399a07fef255643f4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:54.746428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] RBAC: Authorizing `identity:delete_project(project_id=845d51abb49b42a399a07fef255643f4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:54.748320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:54.799003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845d51abb49b42a399a07fef255643f4', 'request_id': 'req-1896b5b3-4d45-45db-8d68-9f9c828b001a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.805210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845d51abb49b42a399a07fef255643f4', 'request_id': 'req-1896b5b3-4d45-45db-8d68-9f9c828b001a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.812788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845d51abb49b42a399a07fef255643f4', 'request_id': 'req-1896b5b3-4d45-45db-8d68-9f9c828b001a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.819686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:54.824602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] The token cache is being invalidate because project 845d51abb49b42a399a07fef255643f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:54.825098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.826202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.827775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1031/2055] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:54 2022] DELETE /identity/v3/projects/845d51abb49b42a399a07fef255643f4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:54.831814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:54.842976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb6df-46a7-4ba9-90b0-ec9ff1b44bda service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:54.898779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:54.899428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:54.899661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:54.899930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] PATH_INFO: `/v3/users/607a7701e22a4158a6e75f2d6b542a3b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:54.901017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607a7701e22a4158a6e75f2d6b542a3b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:54.903202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:54.948248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607a7701e22a4158a6e75f2d6b542a3b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.955561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607a7701e22a4158a6e75f2d6b542a3b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.956161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607a7701e22a4158a6e75f2d6b542a3b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.967811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607a7701e22a4158a6e75f2d6b542a3b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.974494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607a7701e22a4158a6e75f2d6b542a3b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:54.980262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1025/2056] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:54 2022] DELETE /identity/v3/users/607a7701e22a4158a6e75f2d6b542a3b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:55.247728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:55.249515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:55.268588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896b5b3-4d45-45db-8d68-9f9c828b001a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:55.331000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:55.331666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:55.331947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:55.332216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] PATH_INFO: `/v3/projects/60e31e467f0049f4b408fb8bd9a3d7d6` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:55.333465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e31e467f0049f4b408fb8bd9a3d7d6)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:55.335357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:55.400820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e31e467f0049f4b408fb8bd9a3d7d6', 'request_id': 'req-40114ba7-9a5c-44a4-a640-558dac9954e8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.407780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e31e467f0049f4b408fb8bd9a3d7d6', 'request_id': 'req-40114ba7-9a5c-44a4-a640-558dac9954e8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.421111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e31e467f0049f4b408fb8bd9a3d7d6', 'request_id': 'req-40114ba7-9a5c-44a4-a640-558dac9954e8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.435270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] The token cache is being invalidate because project 60e31e467f0049f4b408fb8bd9a3d7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:55.435563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.436234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.438133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1032/2057] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:55 2022] DELETE /identity/v3/projects/60e31e467f0049f4b408fb8bd9a3d7d6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:55.442016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:55.445799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:55.460617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa4e1-8986-4000-acd6-3f18e91bcb26 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:55.556324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:55.557277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:55.557743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:55.558331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] PATH_INFO: `/v3/users/7fbe75f38f654eb1b096f148399bc1ef` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:55.559665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbe75f38f654eb1b096f148399bc1ef)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:55.561941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:55.577381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:55.625929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbe75f38f654eb1b096f148399bc1ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.634973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbe75f38f654eb1b096f148399bc1ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.635678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbe75f38f654eb1b096f148399bc1ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.648907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbe75f38f654eb1b096f148399bc1ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.658501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6000b066-8f99-4d6d-9020-417416e11e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbe75f38f654eb1b096f148399bc1ef'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:55.665278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1026/2058] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:55 2022] DELETE /identity/v3/users/7fbe75f38f654eb1b096f148399bc1ef => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:55.944183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:55.945903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:55.960379 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40114ba7-9a5c-44a4-a640-558dac9954e8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.015782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.016340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.016614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.016882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] PATH_INFO: `/v3/projects/d44fbba6f08d483898d5aa1f8b150d8b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.018124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44fbba6f08d483898d5aa1f8b150d8b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.020783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.054529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:56.070079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44fbba6f08d483898d5aa1f8b150d8b', 'request_id': 'req-e40f8fac-f2df-4946-bd5e-60f51105f2fd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:56.076085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44fbba6f08d483898d5aa1f8b150d8b', 'request_id': 'req-e40f8fac-f2df-4946-bd5e-60f51105f2fd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:56.083766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44fbba6f08d483898d5aa1f8b150d8b', 'request_id': 'req-e40f8fac-f2df-4946-bd5e-60f51105f2fd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:56.093942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] The token cache is being invalidate because project d44fbba6f08d483898d5aa1f8b150d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:56.094228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:56.094852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e40f8fac-f2df-4946-bd5e-60f51105f2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:56.096335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1033/2059] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:55 2022] DELETE /identity/v3/projects/d44fbba6f08d483898d5aa1f8b150d8b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:56.101202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.101672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.101813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.121943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:56.123192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:56.180878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1027/2060] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:56.188572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.188853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.189125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.209116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:56.210345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:56.218052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1034/2061] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:56.222094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.231815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dfb97-8925-43f6-b13d-cf659983f111 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.236385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.236979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.237279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.237567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.238206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:56.238532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.240104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.251349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1028/2062] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:56.256118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.265142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c46d-6e94-496b-bd67-6a7bb4543e7a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.269825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.270889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.271159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.271424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.272043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.273981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.301046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1035/2063] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:56 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:56.305129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.314959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348a8f5-5268-45fd-962f-90bf927b1d8c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.372041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.372652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.372937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.373213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.373876 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.375842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.395926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1029/2064] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:56 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:56.400380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.410708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739a0df-ac93-4bce-8e8f-587ef9789e01 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.415353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.415953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.416230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.416502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.417137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.418749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.428988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1036/2065] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:56.432947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.443706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b3f2-e8e0-4659-9ab1-fd4f049eddcb admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.448554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529cb19-e037-4536-9f6a-b76831bfd3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.449193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cb19-e037-4536-9f6a-b76831bfd3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.449496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cb19-e037-4536-9f6a-b76831bfd3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.449766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cb19-e037-4536-9f6a-b76831bfd3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.450393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529cb19-e037-4536-9f6a-b76831bfd3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.452114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529cb19-e037-4536-9f6a-b76831bfd3c3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.453474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:56.465617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1030/2066] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:56.469206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.479089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d028-ad4d-4bd5-984b-0121af9ff39b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.483634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.484277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.484552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.484821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] PATH_INFO: `/v3/projects/a0dbdbca51a840adbcd5cd6171a0c954/users/9aba88c1c03745789f465ad25aee4f55/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.499387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dbdbca51a840adbcd5cd6171a0c954, user_id=9aba88c1c03745789f465ad25aee4f55, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.502042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.515080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1037/2067] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:56 2022] PUT /identity/v3/projects/a0dbdbca51a840adbcd5cd6171a0c954/users/9aba88c1c03745789f465ad25aee4f55/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:58:56.526611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791f73-49e4-4932-8945-02e2acfd2c98 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.526839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791f73-49e4-4932-8945-02e2acfd2c98 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.527113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791f73-49e4-4932-8945-02e2acfd2c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.554063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4e791f73-49e4-4932-8945-02e2acfd2c98 None None] MFA Rules not processed for user `9aba88c1c03745789f465ad25aee4f55`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:56.555252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4e791f73-49e4-4932-8945-02e2acfd2c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:56.619007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1031/2068] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:58:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:56.630780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:56.632464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:56.688972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52b8c5-b9cc-417c-a978-a3a00cba1958 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:56.693517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104bde8-d0c5-4ea9-b38d-3084b04da3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:56.694588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104bde8-d0c5-4ea9-b38d-3084b04da3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:56.694673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104bde8-d0c5-4ea9-b38d-3084b04da3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:56.694944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104bde8-d0c5-4ea9-b38d-3084b04da3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:56.704392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104bde8-d0c5-4ea9-b38d-3084b04da3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:56.705989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104bde8-d0c5-4ea9-b38d-3084b04da3f1 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:56.716645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1038/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:06.616222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=34 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:06.646881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a08e4-d163-4752-8520-9e46326cbe2b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:06.647170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a08e4-d163-4752-8520-9e46326cbe2b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:06.647448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a08e4-d163-4752-8520-9e46326cbe2b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:06.648940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1032/2070] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 07:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:59:06.661346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:06.661859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:06.661940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:06.681505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] MFA Rules not processed for user `8e9e01118c984c2b895bad9d696d586b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:06.682695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:06.741746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:06.746995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a08e4-d163-4752-8520-9e46326cbe2b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:06.748762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a88a08e4-d163-4752-8520-9e46326cbe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:06.760001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1039/2071] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 07:59:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:06.771196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:06.772548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:06.786256 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89be66-ddc9-4133-aa56-47c9599b2633 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:06.791270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:06.791863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:06.792141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:06.792406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:06.800597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:06.802829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:06.812261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1040/2072] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:06.817481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a08e4-d163-4752-8520-9e46326cbe2b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:06.823212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:06.823722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:06.824031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:06.824305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] PATH_INFO: `/v3/users/85637ddc957645339d4f92a909442640` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:06.825950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85637ddc957645339d4f92a909442640)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:06.828015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:06.876660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85637ddc957645339d4f92a909442640'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:06.884028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85637ddc957645339d4f92a909442640'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:06.884777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85637ddc957645339d4f92a909442640'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:06.897252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85637ddc957645339d4f92a909442640'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:06.904271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ce9d828c-27c0-417d-9cff-c00651470240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85637ddc957645339d4f92a909442640'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:06.910122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1033/2073] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:06 2022] DELETE /identity/v3/users/85637ddc957645339d4f92a909442640 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:59:07.078952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.092106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eec09-2247-4eb5-b6e8-6b5802fbfb53 service placement] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.149856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.150484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.150767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.151041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] PATH_INFO: `/v3/projects/b950f7a00f104a8aba30fe929bba0dd6` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.152403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b950f7a00f104a8aba30fe929bba0dd6)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.154338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.199665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b950f7a00f104a8aba30fe929bba0dd6', 'request_id': 'req-45862399-dca8-4fc7-b410-92a2cbc3d519'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:07.205663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b950f7a00f104a8aba30fe929bba0dd6', 'request_id': 'req-45862399-dca8-4fc7-b410-92a2cbc3d519'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:07.212840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b950f7a00f104a8aba30fe929bba0dd6', 'request_id': 'req-45862399-dca8-4fc7-b410-92a2cbc3d519'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:07.223269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] The token cache is being invalidate because project b950f7a00f104a8aba30fe929bba0dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:07.223559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:07.224192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-45862399-dca8-4fc7-b410-92a2cbc3d519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:07.225720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1041/2074] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:07 2022] DELETE /identity/v3/projects/b950f7a00f104a8aba30fe929bba0dd6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:07.230551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.230840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.231118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.250238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:07.251435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:07.309993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1034/2075] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:07.319135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.319454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.319735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.339458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:07.340675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:07.348705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1042/2076] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:07.352877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.362707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54be8bd-537b-4c82-89c1-2d4db24560e3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.367423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.368022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.368298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.368567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.369200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:07.369571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.371195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.383067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1035/2077] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:07.387210 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.397186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d557a-a26d-47c5-80af-2178c48d64c4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.402179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.402768 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.403047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.403318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.403934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.405851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.432267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1043/2078] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:07.436248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.446937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058af6cc-6b95-4b67-b026-fc7208b18721 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.450659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:07.510182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.511011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.511359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.511585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.512210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.514299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.542175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1036/2079] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/users => generated 279 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:07.546033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.557736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58008-8b8c-4eaf-9d56-8583cff51f3e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.562750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.563428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.563785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.564132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.564851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.567114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.578010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1044/2080] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:07.583029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.612567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587341-d6b9-40e9-b73c-3e52f4df2144 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.618054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b818fe-8253-414d-900f-e4dff5acf34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.618587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b818fe-8253-414d-900f-e4dff5acf34c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.619010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b818fe-8253-414d-900f-e4dff5acf34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.619289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b818fe-8253-414d-900f-e4dff5acf34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.619931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b818fe-8253-414d-900f-e4dff5acf34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.621571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b818fe-8253-414d-900f-e4dff5acf34c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.633028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1037/2081] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:07.637217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.647366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dbe40-4bd1-4b76-ba59-9c6668be4596 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.652544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.653205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.653520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.653830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] PATH_INFO: `/v3/projects/4ae0a3bb88574aafab0a7d18c0a403e6/users/2ce9d195bd6849fe8994ff3e4c21cd64/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.670618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae0a3bb88574aafab0a7d18c0a403e6, user_id=2ce9d195bd6849fe8994ff3e4c21cd64, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.673378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.687606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1045/2082] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:07 2022] PUT /identity/v3/projects/4ae0a3bb88574aafab0a7d18c0a403e6/users/2ce9d195bd6849fe8994ff3e4c21cd64/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:07.698743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.699001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.699397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.730730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] MFA Rules not processed for user `2ce9d195bd6849fe8994ff3e4c21cd64`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:07.731966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:07.805053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1038/2083] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:07.809349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.819590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:07.882829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368cd5b-427f-49b6-80c5-a0ce2438429f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.887725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.888661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.888940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.889283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.889935 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.891875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:07.917799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1046/2084] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:59:07.921842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:07.933023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032763-1fe0-49e7-89b3-b8f83415ae10 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:07.987536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:07.988148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:07.989039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:07.989325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:07.989949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:07.991846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.011451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1039/2085] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:07 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:08.015450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:08.025897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa611-bdfb-4ce3-96fd-49432ea34ff5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:08.030932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:08.031522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.031795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.032066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.032719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:08.034347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.045093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1047/2086] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:08.049016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:08.055845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:08.059785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b86a0-3446-43ba-a5fa-3e2ae0ac95cd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:08.065538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:08.066260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.066564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.066857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] PATH_INFO: `/v3/projects/5dd31a6cc0b24f39846847f32d737de3/users/288800ed20cf408b83f5a1523f514e66/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.081184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd31a6cc0b24f39846847f32d737de3, user_id=288800ed20cf408b83f5a1523f514e66, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:08.083900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.095877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1040/2087] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:08 2022] PUT /identity/v3/projects/5dd31a6cc0b24f39846847f32d737de3/users/288800ed20cf408b83f5a1523f514e66/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:08.100188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:08.110302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3216-f2e8-4c99-87a4-d440475a5b3f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:08.165891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42360-22d9-4a74-aed8-805e8a8246fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:08.166489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42360-22d9-4a74-aed8-805e8a8246fb admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.166775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42360-22d9-4a74-aed8-805e8a8246fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.167045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42360-22d9-4a74-aed8-805e8a8246fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.167668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42360-22d9-4a74-aed8-805e8a8246fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:08.169285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42360-22d9-4a74-aed8-805e8a8246fb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.179488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1048/2088] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:08.183970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:08.194105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a662-6421-4bac-8cd8-5d3daf0ffa9e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:08.198742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:08.199387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.199670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.199945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] PATH_INFO: `/v3/projects/5dd31a6cc0b24f39846847f32d737de3/users/288800ed20cf408b83f5a1523f514e66/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.201869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd31a6cc0b24f39846847f32d737de3, user_id=288800ed20cf408b83f5a1523f514e66, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:08.204480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.214452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1041/2089] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:08 2022] PUT /identity/v3/projects/5dd31a6cc0b24f39846847f32d737de3/users/288800ed20cf408b83f5a1523f514e66/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:08.226161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.226466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.226740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.255959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] MFA Rules not processed for user `288800ed20cf408b83f5a1523f514e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:08.257153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:08.322816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1049/2090] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:08.334390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:08.336163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:08.393881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0876e9-f1f2-4cf2-8e4b-4fc8e11a1102 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:08.398016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:08.398610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.398888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.399157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.408159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:08.409626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.419552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1042/2091] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:08.491662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:08.496325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:08.502806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efc134-5559-49ae-b2c4-8bdb5ba6948e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:08.506740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf25bd-b419-442f-a710-e01a6b5bddef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:08.507332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf25bd-b419-442f-a710-e01a6b5bddef service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:08.507608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf25bd-b419-442f-a710-e01a6b5bddef service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:08.507877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf25bd-b419-442f-a710-e01a6b5bddef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:08.563407 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf25bd-b419-442f-a710-e01a6b5bddef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:08.564826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf25bd-b419-442f-a710-e01a6b5bddef service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:08.573560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1050/2092] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:18.415324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:18.569580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=27 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:23.849393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:23.912650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21006ddd-e6e5-48e3-b324-150a64e74564 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:23.917130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:23.917778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:23.918060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:23.918342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] PATH_INFO: `/v3/users/2ce9d195bd6849fe8994ff3e4c21cd64` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:23.919475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce9d195bd6849fe8994ff3e4c21cd64)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:23.921409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:23.972529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce9d195bd6849fe8994ff3e4c21cd64'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:23.979464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce9d195bd6849fe8994ff3e4c21cd64'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:23.980065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce9d195bd6849fe8994ff3e4c21cd64'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:23.992398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce9d195bd6849fe8994ff3e4c21cd64'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:23.999165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce9d195bd6849fe8994ff3e4c21cd64'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.005627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1043/2093] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:23 2022] DELETE /identity/v3/users/2ce9d195bd6849fe8994ff3e4c21cd64 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:24.010100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:24.010553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:24.010685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:24.029139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:24.030352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:24.086240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1051/2094] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:24.095906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:24.097340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:24.153422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba2108-5b3a-4615-8eed-97753a2644cc admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:24.156966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:24.157588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:24.157864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:24.158130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:24.167592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:24.169051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:24.178936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1044/2095] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:24.439062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:24.440513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:24.453924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78cffa-2bd0-4be9-a85d-0bb8c3172167 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:24.459119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:24.459776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:24.460051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:24.460317 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] PATH_INFO: `/v3/projects/4ae0a3bb88574aafab0a7d18c0a403e6` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:24.461465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae0a3bb88574aafab0a7d18c0a403e6)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:24.463342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:24.510576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae0a3bb88574aafab0a7d18c0a403e6', 'request_id': 'req-46039593-711f-4206-aa0a-972d92a7c72b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.516490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae0a3bb88574aafab0a7d18c0a403e6', 'request_id': 'req-46039593-711f-4206-aa0a-972d92a7c72b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.524662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae0a3bb88574aafab0a7d18c0a403e6', 'request_id': 'req-46039593-711f-4206-aa0a-972d92a7c72b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.535038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] The token cache is being invalidate because project 4ae0a3bb88574aafab0a7d18c0a403e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:24.535325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.536516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.538007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1052/2096] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:24 2022] DELETE /identity/v3/projects/4ae0a3bb88574aafab0a7d18c0a403e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:24.542167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:24.551639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face64d-61ec-48d0-ae61-04c3e12a4542 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:24.569433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:24.609507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:24.610068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:24.610349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:24.610624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] PATH_INFO: `/v3/users/288800ed20cf408b83f5a1523f514e66` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:24.611737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288800ed20cf408b83f5a1523f514e66)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:24.613687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:24.657878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288800ed20cf408b83f5a1523f514e66'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.666210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288800ed20cf408b83f5a1523f514e66'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.666829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288800ed20cf408b83f5a1523f514e66'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.678698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288800ed20cf408b83f5a1523f514e66'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.685445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41bb4806-3824-437e-802f-9000565a5064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288800ed20cf408b83f5a1523f514e66'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:24.691336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1045/2097] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:24 2022] DELETE /identity/v3/users/288800ed20cf408b83f5a1523f514e66 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:24.979962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:24.981403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:24.994744 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039593-711f-4206-aa0a-972d92a7c72b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.063339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.064039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.064242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.064514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] PATH_INFO: `/v3/projects/5dd31a6cc0b24f39846847f32d737de3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.065677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd31a6cc0b24f39846847f32d737de3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.068104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.099276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:25.116778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd31a6cc0b24f39846847f32d737de3', 'request_id': 'req-40ec741b-c55b-47ad-969d-dc71e630e877'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:25.122780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd31a6cc0b24f39846847f32d737de3', 'request_id': 'req-40ec741b-c55b-47ad-969d-dc71e630e877'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:25.129890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd31a6cc0b24f39846847f32d737de3', 'request_id': 'req-40ec741b-c55b-47ad-969d-dc71e630e877'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:25.140307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] The token cache is being invalidate because project 5dd31a6cc0b24f39846847f32d737de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:25.140597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:25.141227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-40ec741b-c55b-47ad-969d-dc71e630e877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:25.142732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1053/2098] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:24 2022] DELETE /identity/v3/projects/5dd31a6cc0b24f39846847f32d737de3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:25.148110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.148612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.148707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.167902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:25.169104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:25.227940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1046/2099] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:25.235958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.236243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.236517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.256479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:25.257690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:25.265337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1054/2100] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:25.269524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.279264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d1826-b545-4870-bb06-59012d9d75e0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.283798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.284409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.284686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.285630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:25.285931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.287524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.298791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1047/2101] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:59:25.303496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.312708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3f139-e531-45dc-86c7-72c361bb86a4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.317982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.318592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.318866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.319132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.319741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.322214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.352516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1055/2102] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:25.356690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.367219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449386d-74bb-4356-aa9e-b4a4cb907156 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.392566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:25.423460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.424058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.424338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.424611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.425231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.427662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.448018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1048/2103] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:25.452187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.462288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17682-6b0e-4bae-8d34-d64169e2b30a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.466956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.467614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.467896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.468168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.468799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.470458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.480367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1056/2104] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:59:25.484137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.494564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317395f-5362-4134-9c2f-753911ff4a63 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.499154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde0cc5-ef63-48b0-b86c-abd89c514524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.499750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde0cc5-ef63-48b0-b86c-abd89c514524 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.500032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde0cc5-ef63-48b0-b86c-abd89c514524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.500307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde0cc5-ef63-48b0-b86c-abd89c514524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.500935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde0cc5-ef63-48b0-b86c-abd89c514524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.502583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde0cc5-ef63-48b0-b86c-abd89c514524 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.513669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1049/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:25.517797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.527816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de84e32-0fa6-4762-ae97-2e2c16907b27 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.532339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.532976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.533251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.533549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] PATH_INFO: `/v3/projects/a922589b9201457fa15f52bd2aa18fa3/users/eff60d0293e14c0aa69934daccc49d56/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.547669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a922589b9201457fa15f52bd2aa18fa3, user_id=eff60d0293e14c0aa69934daccc49d56, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.550316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.563118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1057/2106] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:25 2022] PUT /identity/v3/projects/a922589b9201457fa15f52bd2aa18fa3/users/eff60d0293e14c0aa69934daccc49d56/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:25.574052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.574342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.574621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.602258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] MFA Rules not processed for user `eff60d0293e14c0aa69934daccc49d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:25.603461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:25.668023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1050/2107] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:25.672537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.732881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38699c94-6ed7-4a32-995d-66dacaa07070 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.737574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.738170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.738449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.739245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.739861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.741766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.766972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1058/2108] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:25.771006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.781933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbf7d-9b41-4cde-aa0f-389f76e15732 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.836897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.837539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.837921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.838099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.838741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.840844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.861789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1051/2109] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:25 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:25.866384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.876544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd00aae-43f4-435e-95aa-742207f653d4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.881295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.881827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.882104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.882371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.882995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.884564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.898282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1059/2110] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:25.902569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.913008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2657f-2222-4682-908b-c1977d53bd0e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.918163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:25.918808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:25.919132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:25.919407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] PATH_INFO: `/v3/projects/2e1ef73034ab479b8a62543ae5f60a3f/users/9ca7727a167740408f32b9f2db234236/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:25.934927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1ef73034ab479b8a62543ae5f60a3f, user_id=9ca7727a167740408f32b9f2db234236, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:25.937644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:25.951720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1052/2111] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:25 2022] PUT /identity/v3/projects/2e1ef73034ab479b8a62543ae5f60a3f/users/9ca7727a167740408f32b9f2db234236/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:25.956049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:25.966639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93fa5b-b62d-44db-8697-1c648c718af7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:25.986677 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:26.024184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410445c-aa37-4553-a811-fe4ddd604e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.024787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410445c-aa37-4553-a811-fe4ddd604e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.025065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410445c-aa37-4553-a811-fe4ddd604e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.025378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410445c-aa37-4553-a811-fe4ddd604e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.026006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410445c-aa37-4553-a811-fe4ddd604e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.027838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410445c-aa37-4553-a811-fe4ddd604e7f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.037929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1060/2112] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:26.041996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:26.047354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:26.053683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c51ba6-6456-4f4f-8b98-129c32c5d574 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:26.058617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.059265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.059544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.059816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] PATH_INFO: `/v3/projects/2e1ef73034ab479b8a62543ae5f60a3f/users/9ca7727a167740408f32b9f2db234236/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.061750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1ef73034ab479b8a62543ae5f60a3f, user_id=9ca7727a167740408f32b9f2db234236, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.064356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.074497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1053/2113] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:26 2022] PUT /identity/v3/projects/2e1ef73034ab479b8a62543ae5f60a3f/users/9ca7727a167740408f32b9f2db234236/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:26.086162 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.086636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.086737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.114574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] MFA Rules not processed for user `9ca7727a167740408f32b9f2db234236`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:26.115844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:26.188887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1061/2114] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:26.201171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:26.202970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:26.260510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c714a-fe5b-4bb8-8102-b6cfb79de676 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:26.264192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.264781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.265057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.265359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.274685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.276096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.285672 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1054/2115] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:26.588427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:26.597501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a670e1-509e-40a4-b9ea-a593e744e8a3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:26.603392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca7727a167740408f32b9f2db234236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1ef73034ab479b8a62543ae5f60a3f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.604043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.604331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.604610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.605283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:26.605591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.607181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.619402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1062/2116] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:26.623541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:26.632653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8a8a-2590-49ad-aba3-74897bf97f13 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:26.637249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca7727a167740408f32b9f2db234236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1ef73034ab479b8a62543ae5f60a3f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.637868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.638150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.638424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.639051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.640933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.667403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1055/2117] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:26 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:26.671416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:26.681851 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb70fd-c3ef-44d9-82ce-10878a869fbb tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:26.742760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca7727a167740408f32b9f2db234236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1ef73034ab479b8a62543ae5f60a3f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.743293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.743578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.743858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.744501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:26.744810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.746427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.757991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1063/2118] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:26.794500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:26.805205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56cb2-7aeb-4814-9b03-95d0d7ea6fcc tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:26.809738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca7727a167740408f32b9f2db234236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1ef73034ab479b8a62543ae5f60a3f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:26.810353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:26.810659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:26.810939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] PATH_INFO: `/v3/projects/9e0409bc6a4f47ef92f9636aaced4af5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:26.812035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e0409bc6a4f47ef92f9636aaced4af5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:26.813996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:26.861189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0409bc6a4f47ef92f9636aaced4af5', 'request_id': 'req-4f1d6468-b44a-4361-99d8-76aed0eff712'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:26.867770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0409bc6a4f47ef92f9636aaced4af5', 'request_id': 'req-4f1d6468-b44a-4361-99d8-76aed0eff712'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:26.874793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0409bc6a4f47ef92f9636aaced4af5', 'request_id': 'req-4f1d6468-b44a-4361-99d8-76aed0eff712'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:26.884940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] The token cache is being invalidate because project 9e0409bc6a4f47ef92f9636aaced4af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:26.885224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:26.885898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4f1d6468-b44a-4361-99d8-76aed0eff712 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:26.887341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1056/2119] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:26 2022] DELETE /identity/v3/projects/9e0409bc6a4f47ef92f9636aaced4af5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:27.078420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:27.080105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:27.110974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:27.144221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20bd9-7683-4591-bd93-4ef8d34efea2 tempest-VolumeQuotaClassesTest-749486470 tempest-VolumeQuotaClassesTest-749486470-project-admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:27.197819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:27.198439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:27.198716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:27.198985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] PATH_INFO: `/v3/users/eff60d0293e14c0aa69934daccc49d56` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:27.200074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff60d0293e14c0aa69934daccc49d56)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:27.202021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:27.245733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff60d0293e14c0aa69934daccc49d56'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.246363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff60d0293e14c0aa69934daccc49d56'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.253352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff60d0293e14c0aa69934daccc49d56'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.266065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff60d0293e14c0aa69934daccc49d56'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.273615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff60d0293e14c0aa69934daccc49d56'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.279771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1064/2120] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:27 2022] DELETE /identity/v3/users/eff60d0293e14c0aa69934daccc49d56 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:27.284274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:27.284707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:27.284956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:27.303870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:27.305073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:27.356113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:27.371535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1057/2121] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:27.381678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:27.383204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:27.443133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7b81e-dad0-447a-874a-cdaf0ee7c834 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:27.446745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:27.447350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:27.447625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:27.447894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:27.454539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:27.456764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:27.459366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:27.470202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1065/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:27.738324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:27.740305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:27.752252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7366c5-122c-4e4c-bc78-6a684694a346 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:27.757417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:27.758052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:27.758335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:27.758609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] PATH_INFO: `/v3/projects/a922589b9201457fa15f52bd2aa18fa3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:27.759729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a922589b9201457fa15f52bd2aa18fa3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:27.761677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:27.809186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a922589b9201457fa15f52bd2aa18fa3', 'request_id': 'req-70a7fff6-1b27-4c63-a367-c0fda46b1cff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.815301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a922589b9201457fa15f52bd2aa18fa3', 'request_id': 'req-70a7fff6-1b27-4c63-a367-c0fda46b1cff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.823622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a922589b9201457fa15f52bd2aa18fa3', 'request_id': 'req-70a7fff6-1b27-4c63-a367-c0fda46b1cff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.834208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] The token cache is being invalidate because project a922589b9201457fa15f52bd2aa18fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:27.834476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.835118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.836575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1058/2123] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:27 2022] DELETE /identity/v3/projects/a922589b9201457fa15f52bd2aa18fa3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:27.841310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:27.851330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d1723-bb8d-40ae-84a6-ce69eb0e7a0f service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:27.906074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:27.906695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:27.906973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:27.907251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] PATH_INFO: `/v3/users/9ca7727a167740408f32b9f2db234236` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:27.908352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca7727a167740408f32b9f2db234236)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:27.910826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:27.954983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca7727a167740408f32b9f2db234236'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.955608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca7727a167740408f32b9f2db234236'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.962777 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca7727a167740408f32b9f2db234236'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.975077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca7727a167740408f32b9f2db234236'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.982250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f9da006d-ae6c-4a98-b61e-6c461e864e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca7727a167740408f32b9f2db234236'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:27.992724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1066/2124] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:27 2022] DELETE /identity/v3/users/9ca7727a167740408f32b9f2db234236 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:28.264931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.266462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:28.282099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fff6-1b27-4c63-a367-c0fda46b1cff admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.340471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.341077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.341328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.341606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] PATH_INFO: `/v3/projects/2e1ef73034ab479b8a62543ae5f60a3f` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.342721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1ef73034ab479b8a62543ae5f60a3f)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.344624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.390086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1ef73034ab479b8a62543ae5f60a3f', 'request_id': 'req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:28.396513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1ef73034ab479b8a62543ae5f60a3f', 'request_id': 'req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:28.404715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1ef73034ab479b8a62543ae5f60a3f', 'request_id': 'req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:28.415988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] The token cache is being invalidate because project 2e1ef73034ab479b8a62543ae5f60a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:28.416274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:28.416892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b1e5d0d9-8b0a-4a62-966d-9b5d338869c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:28.418383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1059/2125] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:28 2022] DELETE /identity/v3/projects/2e1ef73034ab479b8a62543ae5f60a3f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:28.424134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.424590 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.424698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.443725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:28.444947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:28.504423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1067/2126] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:28.512571 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.512859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.513137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.528163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:28.533997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:28.536185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:28.545587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1060/2127] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:28.549815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.559615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff321-f13b-4f5d-a4ce-5d05ed23e590 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.564125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.564723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.565001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.565294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.565933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:28.566233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.568320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.579819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1068/2128] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:28.584579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.594056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a368b-bb16-4199-a066-af98732b1a13 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.598897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.599505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.599771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.600042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.600659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.602561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.629526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1061/2129] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:28.633580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.638746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:28.645560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cad9-bbfc-42ee-982a-821402f9a346 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.703141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.703756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.704039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.704315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.704964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.706921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.728133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1069/2130] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:28 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:28.732267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.742650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f08de-a6e9-40c0-b76a-758fd94573de admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.747363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.747961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.748238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.748507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.749167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.750773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.761196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1062/2131] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:28.765248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.775721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d2cb-b0a6-4bbb-a9da-cd94de97cff5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.780533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6842b4-79dc-4af4-9e02-9f69ceb04539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.781138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6842b4-79dc-4af4-9e02-9f69ceb04539 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.781456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6842b4-79dc-4af4-9e02-9f69ceb04539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.781730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6842b4-79dc-4af4-9e02-9f69ceb04539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.782370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6842b4-79dc-4af4-9e02-9f69ceb04539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.783949 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6842b4-79dc-4af4-9e02-9f69ceb04539 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.794369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1070/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:28.798637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:28.808745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234a22-82e6-41aa-9d21-1eddf06b352b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:28.813381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:28.814160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.814417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.814707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] PATH_INFO: `/v3/projects/cb36e378abb046f6b6ebda7d843b911d/users/48924373ee6248218e6e27d2a5483f1d/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.829786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb36e378abb046f6b6ebda7d843b911d, user_id=48924373ee6248218e6e27d2a5483f1d, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:28.832938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:28.845841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1063/2133] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:28 2022] PUT /identity/v3/projects/cb36e378abb046f6b6ebda7d843b911d/users/48924373ee6248218e6e27d2a5483f1d/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:28.857270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:28.857646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:28.858042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:28.886766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] MFA Rules not processed for user `48924373ee6248218e6e27d2a5483f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:28.887958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:28.950428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1071/2134] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:28.954784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.016261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934058c-5175-4bdc-ab1c-3d370afc6c77 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.021341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.021952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.022235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.022513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.023135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.025045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.051630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1064/2135] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:28 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:29.055727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.067395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d69e4-8264-4bff-b235-a6ae5c84f547 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.124437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.124973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.125250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.125550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.126178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.128093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.144532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:29.150267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1072/2136] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:29 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:29.154305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.164476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768bd6-12b5-4521-bb2d-43f08d2fa7b6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.169067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.169692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.169973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.170248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.170872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.172445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.183480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1065/2137] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:29.187294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.198005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc5fb8-60a7-4c51-89ef-c7c86f7ae374 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.202577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.203215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.203490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.203761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] PATH_INFO: `/v3/projects/496fb17305b246268860ee706c4ee267/users/1249deb267404f32bd315935b2b39769/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.218046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496fb17305b246268860ee706c4ee267, user_id=1249deb267404f32bd315935b2b39769, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.220691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.233371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1073/2138] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:29 2022] PUT /identity/v3/projects/496fb17305b246268860ee706c4ee267/users/1249deb267404f32bd315935b2b39769/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:59:29.237222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.247668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a569-dca7-464e-852c-1e046a2a9780 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.303349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df45f00-0122-409d-9f06-d7a05ea1735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.304027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df45f00-0122-409d-9f06-d7a05ea1735f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.304372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df45f00-0122-409d-9f06-d7a05ea1735f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.304626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df45f00-0122-409d-9f06-d7a05ea1735f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.305273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df45f00-0122-409d-9f06-d7a05ea1735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.306879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df45f00-0122-409d-9f06-d7a05ea1735f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.317089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1066/2139] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:29.321363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.331628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735e9c3-117b-42bf-bad8-54661e5d0a86 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.336304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.336951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.337230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.337604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] PATH_INFO: `/v3/projects/496fb17305b246268860ee706c4ee267/users/1249deb267404f32bd315935b2b39769/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.341942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496fb17305b246268860ee706c4ee267, user_id=1249deb267404f32bd315935b2b39769, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.344599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.355491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1074/2140] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:29 2022] PUT /identity/v3/projects/496fb17305b246268860ee706c4ee267/users/1249deb267404f32bd315935b2b39769/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:29.366237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.366721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.366835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.391338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:29.394408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] MFA Rules not processed for user `1249deb267404f32bd315935b2b39769`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:29.396406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:29.463949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1067/2141] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:29.475331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:29.476994 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:29.533927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178333ea-12f7-40d0-b6d9-4e037d0b0955 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:29.538038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad273ba3-0481-419a-bb5b-05a11d1f05bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:29.538631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273ba3-0481-419a-bb5b-05a11d1f05bd service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:29.538905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273ba3-0481-419a-bb5b-05a11d1f05bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:29.539169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273ba3-0481-419a-bb5b-05a11d1f05bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:29.547855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad273ba3-0481-419a-bb5b-05a11d1f05bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:29.549285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad273ba3-0481-419a-bb5b-05a11d1f05bd service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:29.558989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1075/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:30.137931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:30.200435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad7d8c-2fac-44b0-9320-46f7acec139a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:30.204959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:30.205552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:30.205834 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:30.206107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] PATH_INFO: `/v3/users/48924373ee6248218e6e27d2a5483f1d` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:30.207824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] RBAC: Authorizing `identity:delete_user(user_id=48924373ee6248218e6e27d2a5483f1d)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:30.209771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:30.254424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48924373ee6248218e6e27d2a5483f1d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.262036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48924373ee6248218e6e27d2a5483f1d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.262877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48924373ee6248218e6e27d2a5483f1d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.275266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48924373ee6248218e6e27d2a5483f1d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.282082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48924373ee6248218e6e27d2a5483f1d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.287746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1068/2143] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:30 2022] DELETE /identity/v3/users/48924373ee6248218e6e27d2a5483f1d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:30.292295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:30.292579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:30.292848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:30.312577 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:30.313825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:30.374952 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1076/2144] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:30.385324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:30.387067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:30.408542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:30.447693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a6f58-fc4e-46d8-9ccf-ce18d7aa17da admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:30.451285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:30.451884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:30.452161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:30.452432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:30.462097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:30.463460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:30.473015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1069/2145] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:59:30.739569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:30.741037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:30.755058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedaabc-2445-4cfc-b047-48f8e9a03b92 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:30.759706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:30.760341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:30.760640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:30.760914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] PATH_INFO: `/v3/projects/cb36e378abb046f6b6ebda7d843b911d` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:30.762800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb36e378abb046f6b6ebda7d843b911d)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:30.764701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:30.813514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb36e378abb046f6b6ebda7d843b911d', 'request_id': 'req-0476a3b9-192c-4cac-8d4b-c74b89913672'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.820195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb36e378abb046f6b6ebda7d843b911d', 'request_id': 'req-0476a3b9-192c-4cac-8d4b-c74b89913672'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.827925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb36e378abb046f6b6ebda7d843b911d', 'request_id': 'req-0476a3b9-192c-4cac-8d4b-c74b89913672'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.829364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:30.841122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] The token cache is being invalidate because project cb36e378abb046f6b6ebda7d843b911d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:30.841802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.842760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.844303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1077/2146] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:30 2022] DELETE /identity/v3/projects/cb36e378abb046f6b6ebda7d843b911d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:30.848803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:30.858637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fde0c-c15b-46d8-8df2-74fbc8261618 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:30.916233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:30.916866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:30.917141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:30.917443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] PATH_INFO: `/v3/users/1249deb267404f32bd315935b2b39769` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:30.918547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1249deb267404f32bd315935b2b39769)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:30.920437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:30.967304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1249deb267404f32bd315935b2b39769'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.974997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1249deb267404f32bd315935b2b39769'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.975751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1249deb267404f32bd315935b2b39769'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.987719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1249deb267404f32bd315935b2b39769'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:30.994999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f48d7dc3-f154-44ea-ae71-6fab09485355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1249deb267404f32bd315935b2b39769'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:31.001405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1070/2147] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:30 2022] DELETE /identity/v3/users/1249deb267404f32bd315935b2b39769 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:31.278241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.279946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:31.294482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a3b9-192c-4cac-8d4b-c74b89913672 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.369476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.370117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.370394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.370667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] PATH_INFO: `/v3/projects/496fb17305b246268860ee706c4ee267` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.371778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496fb17305b246268860ee706c4ee267)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.373779 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.425644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496fb17305b246268860ee706c4ee267', 'request_id': 'req-7095a47e-164f-4b1f-ac56-05836d6c44e0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:31.432665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496fb17305b246268860ee706c4ee267', 'request_id': 'req-7095a47e-164f-4b1f-ac56-05836d6c44e0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:31.440167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496fb17305b246268860ee706c4ee267', 'request_id': 'req-7095a47e-164f-4b1f-ac56-05836d6c44e0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:31.451199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] The token cache is being invalidate because project 496fb17305b246268860ee706c4ee267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:31.451491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:31.452125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-7095a47e-164f-4b1f-ac56-05836d6c44e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:31.453681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1078/2148] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:31 2022] DELETE /identity/v3/projects/496fb17305b246268860ee706c4ee267 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:31.458583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.459203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.459203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.479576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:31.480837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:31.516620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:31.546343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1071/2149] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:31.555110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.555402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.555711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.577754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:31.578946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:31.586831 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1079/2150] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:31.591198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.601592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03c39-5545-423d-b95c-1b6013822bc3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.606290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.606922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.607195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.607470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.608128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:31.608428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.610055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.622590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1072/2151] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:31.641587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.641587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73051ec2-eb64-4a64-9720-a361ef1936fe None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.645888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.646496 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.646891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.647148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.647832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.649853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.684042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1080/2152] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:31 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:31.685216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.701498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180f0d-1454-49a9-8597-c7fb058041e5 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.759130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.759653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.759939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.760230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.760844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.762832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.783504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1073/2153] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:31 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:31.788093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.798292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1510631-cead-4e6e-9618-c0dfdcd406fd admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.803937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.804610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.804876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.805147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.805904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.807546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.817845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1081/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:31.821897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.831836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bcaef-725e-4169-ba8f-2a20fbfb4177 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.836415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832adb-e293-4228-b2f6-a7dbf3c6f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.837004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832adb-e293-4228-b2f6-a7dbf3c6f7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.837316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832adb-e293-4228-b2f6-a7dbf3c6f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.837591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832adb-e293-4228-b2f6-a7dbf3c6f7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.838446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832adb-e293-4228-b2f6-a7dbf3c6f7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.840285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832adb-e293-4228-b2f6-a7dbf3c6f7aa admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.851969 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1074/2155] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:31.856007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:31.866482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2db3-8c64-4810-9afb-7a98fe0f553b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:31.871140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:31.871776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.872053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.872326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] PATH_INFO: `/v3/projects/5eac54a57bee4a78a402dd4cb990abd3/users/a64e87637a114f2b906dd68f8dfdd4b0/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.886304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eac54a57bee4a78a402dd4cb990abd3, user_id=a64e87637a114f2b906dd68f8dfdd4b0, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:31.888906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:31.901112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1082/2156] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:31 2022] PUT /identity/v3/projects/5eac54a57bee4a78a402dd4cb990abd3/users/a64e87637a114f2b906dd68f8dfdd4b0/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:31.912993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:31.913307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:31.913592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:31.941045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] MFA Rules not processed for user `a64e87637a114f2b906dd68f8dfdd4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:31.942284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:32.006759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1075/2157] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:32.011526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.030603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:32.077795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ce89-390a-4dd7-9a90-349cad14b5a6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.083393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.083999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.084654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.084654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.085207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.087146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.117293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1083/2158] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:32 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:59:32.119017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.129891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3301-9147-445a-b75e-7a6c00ec9383 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.162361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:32.187024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.187625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.187903 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.188173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.188792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.190722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.211155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1076/2159] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:32 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:32.215180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.225784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef7ea-9d22-4b78-a4f1-b1087fb2e557 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.230293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.230880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.231155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.231423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.232048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.233655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.243940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1084/2160] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:32.247803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.258226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c936e74-6bcb-4c13-a66e-8dec5faa4abe admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.262935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba7036-d275-4915-a45f-8e765e762a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.263473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba7036-d275-4915-a45f-8e765e762a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.263758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba7036-d275-4915-a45f-8e765e762a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.264030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba7036-d275-4915-a45f-8e765e762a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.264669 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba7036-d275-4915-a45f-8e765e762a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.266280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba7036-d275-4915-a45f-8e765e762a4a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.277216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1077/2161] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:32.281179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.291591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231afb4-d24d-4c0d-a539-57fb78ebc369 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.296139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.296775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.297054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.297351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] PATH_INFO: `/v3/projects/bded0031abc74ffcaad396d5776c7fb6/users/f1c0990760334edba4f670c517cd209a/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.311974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bded0031abc74ffcaad396d5776c7fb6, user_id=f1c0990760334edba4f670c517cd209a, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.314725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.327234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1085/2162] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:32 2022] PUT /identity/v3/projects/bded0031abc74ffcaad396d5776c7fb6/users/f1c0990760334edba4f670c517cd209a/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:59:32.338148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.338438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.338716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.368416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] MFA Rules not processed for user `f1c0990760334edba4f670c517cd209a`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:32.369979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:32.434596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1078/2163] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:32.439120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.501623 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35abdf-b277-4a58-8944-7f111475b866 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.506263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.506857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.507133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.507405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.508027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.509951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.536302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1086/2164] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:32 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:32.540265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.550842 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f858dc-4d83-4ad5-9bf1-e8fd2c56e783 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.606509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.607142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.607418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.607687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.608300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.610310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.633467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1079/2165] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:32 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:32.637445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.647620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435164f8-50c2-4b9a-a274-3ded6be31437 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.652405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.652993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.653290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.653556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.654178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.655739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.666657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1087/2166] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:32.670630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.681129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbde8-5f0d-48ab-8b34-2794acc56225 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.685678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.686319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.686600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.686873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] PATH_INFO: `/v3/projects/1b2be6694d0a4dbcabc986359b088a3f/users/ea9efd5b69cb41e981536206a6077179/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.701332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2be6694d0a4dbcabc986359b088a3f, user_id=ea9efd5b69cb41e981536206a6077179, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.704113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.719422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1080/2167] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:32 2022] PUT /identity/v3/projects/1b2be6694d0a4dbcabc986359b088a3f/users/ea9efd5b69cb41e981536206a6077179/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:32.724043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.735397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d306d-3517-4dff-bcaa-2cf977ec00c4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.777852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:32.798928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a67e4-93e3-48c8-b023-b719fca72df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.799492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a67e4-93e3-48c8-b023-b719fca72df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.799698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a67e4-93e3-48c8-b023-b719fca72df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.799995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a67e4-93e3-48c8-b023-b719fca72df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.800593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a67e4-93e3-48c8-b023-b719fca72df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.802233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a67e4-93e3-48c8-b023-b719fca72df7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.813334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1088/2168] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:59:32.816257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.826591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff521-4dc0-4e6e-991f-0739e2e33321 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:32.831170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:32.831813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.832088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.832355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] PATH_INFO: `/v3/projects/1b2be6694d0a4dbcabc986359b088a3f/users/ea9efd5b69cb41e981536206a6077179/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.834857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2be6694d0a4dbcabc986359b088a3f, user_id=ea9efd5b69cb41e981536206a6077179, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:32.837773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:32.841989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:32.852790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1081/2169] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:32 2022] PUT /identity/v3/projects/1b2be6694d0a4dbcabc986359b088a3f/users/ea9efd5b69cb41e981536206a6077179/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:32.863573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:32.864009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:32.864252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:32.892229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] MFA Rules not processed for user `ea9efd5b69cb41e981536206a6077179`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:32.893511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:32.964774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1089/2170] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:32.976774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:32.978638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:33.037736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616f699-feab-4b1b-8e09-4eb1f1eb9289 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:33.041363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:33.041979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:33.042262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:33.042537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:33.100286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:33.102102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:33.111454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1082/2171] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:34.628921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:34.639050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4446c-1df5-4fc3-b398-8cd961320094 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:34.642576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:34.643169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:34.643444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:34.643710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:34.698125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:34.699532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:34.708736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1090/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:35.236841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:35.246663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a4625-3ae0-46f7-9942-d714d9521dbc service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:35.250565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca892-686b-492a-b666-1492b30b3dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:35.251169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca892-686b-492a-b666-1492b30b3dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:35.251449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca892-686b-492a-b666-1492b30b3dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:35.251730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca892-686b-492a-b666-1492b30b3dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:35.262307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ca892-686b-492a-b666-1492b30b3dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:35.263742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ca892-686b-492a-b666-1492b30b3dc1 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:35.273724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1083/2173] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:36.221572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:36.222999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:36.286897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5c56b-a557-4278-9e30-ba77d8acf714 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:36.291661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:36.292278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:36.292556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:36.292828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] PATH_INFO: `/v3/users/9aba88c1c03745789f465ad25aee4f55` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:36.293940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aba88c1c03745789f465ad25aee4f55)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:36.295923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:36.297675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:36.343290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aba88c1c03745789f465ad25aee4f55'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.343997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aba88c1c03745789f465ad25aee4f55'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.352885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aba88c1c03745789f465ad25aee4f55'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.364943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aba88c1c03745789f465ad25aee4f55'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.371667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aba88c1c03745789f465ad25aee4f55'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.377438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1091/2174] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:36 2022] DELETE /identity/v3/users/9aba88c1c03745789f465ad25aee4f55 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:36.382575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:36.383030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:36.383121 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:36.402778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:36.404022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:36.465198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1084/2175] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:36.474927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:36.476906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:36.535614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073cfd3-42c0-450d-a611-7d804df4b7e0 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:36.539282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4b10e-92c9-4259-9496-6c1ca82d096d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:36.539892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4b10e-92c9-4259-9496-6c1ca82d096d service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:36.540184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4b10e-92c9-4259-9496-6c1ca82d096d service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:36.540447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4b10e-92c9-4259-9496-6c1ca82d096d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:36.549715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4b10e-92c9-4259-9496-6c1ca82d096d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:36.551149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4b10e-92c9-4259-9496-6c1ca82d096d service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:36.561718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1092/2176] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:36.897069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:36.898520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:36.912371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05b95f-db79-4d4f-84bc-999115656a5f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:36.917020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:36.917690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:36.917974 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:36.918250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] PATH_INFO: `/v3/projects/a0dbdbca51a840adbcd5cd6171a0c954` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:36.919435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dbdbca51a840adbcd5cd6171a0c954)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:36.921382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:36.956339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:36.970017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dbdbca51a840adbcd5cd6171a0c954', 'request_id': 'req-d109b63f-afb9-463d-89ec-0e084a65410c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.976761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dbdbca51a840adbcd5cd6171a0c954', 'request_id': 'req-d109b63f-afb9-463d-89ec-0e084a65410c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.984546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dbdbca51a840adbcd5cd6171a0c954', 'request_id': 'req-d109b63f-afb9-463d-89ec-0e084a65410c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.995193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] The token cache is being invalidate because project a0dbdbca51a840adbcd5cd6171a0c954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:36.995483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.996103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d109b63f-afb9-463d-89ec-0e084a65410c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:36.997619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1085/2177] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:36 2022] DELETE /identity/v3/projects/a0dbdbca51a840adbcd5cd6171a0c954 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:37.002393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.002674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.002976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.022255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:37.023442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:37.081938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1093/2178] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:37.089825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.090108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.090384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.110028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:37.111224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:37.119461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1086/2179] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:37.123675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.133225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19bc24-114e-465d-9cf4-8865285fe620 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.137783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.138378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.138662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.138938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.139583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:37.139885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.141499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.153034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1094/2180] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:37.157188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.166762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b4f09-8b64-4a64-b931-95ee4751ff90 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.171383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.171964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.172242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.172512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.173127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.175037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.202163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1087/2181] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:37 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:37.206485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.216957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c571f-201b-434c-a273-eacad8565be7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.221783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:37.276033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.276813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.277087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.277385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.277999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.279893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.301430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1095/2182] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:37 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:37.305386 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.315875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7f489-9fb5-4000-aa67-23ab87d9fe57 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.320550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.321141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.321451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.321721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.322350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.323910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.334165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1088/2183] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:37.338180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.350409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88462f9-2640-4591-94d0-ed2c107ed2fb admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.355009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47926ce-089d-4c9d-9c86-122d39adad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.355639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47926ce-089d-4c9d-9c86-122d39adad20 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.355912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47926ce-089d-4c9d-9c86-122d39adad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.356181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47926ce-089d-4c9d-9c86-122d39adad20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.356809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47926ce-089d-4c9d-9c86-122d39adad20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.358452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47926ce-089d-4c9d-9c86-122d39adad20 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.368344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1096/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:37.372387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.382411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd709a-b939-47e6-b77a-fbc004d2b0eb admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.387465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.388179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.388494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.388785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] PATH_INFO: `/v3/projects/9bf386ec52fb4acea957087600c2a760/users/71662468e77b43bda5da458a4ddb83c3/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.405433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf386ec52fb4acea957087600c2a760, user_id=71662468e77b43bda5da458a4ddb83c3, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.408494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.422724 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1089/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:37 2022] PUT /identity/v3/projects/9bf386ec52fb4acea957087600c2a760/users/71662468e77b43bda5da458a4ddb83c3/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:37.434091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3df19-4234-4057-84da-e0723b0f2f36 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.434381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3df19-4234-4057-84da-e0723b0f2f36 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.434654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3df19-4234-4057-84da-e0723b0f2f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.465390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-33c3df19-4234-4057-84da-e0723b0f2f36 None None] MFA Rules not processed for user `71662468e77b43bda5da458a4ddb83c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:37.466610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-33c3df19-4234-4057-84da-e0723b0f2f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:37.542693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1097/2186] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:37.554183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:37.555882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:37.627353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34052397-ce96-450e-b295-10fc5bb971e9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:37.631662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:37.632266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:37.632662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:37.633841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:37.643628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:37.646265 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:37.656599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1090/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:39.091793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ac6bd-a7d5-469d-9f60-9182b03387f3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:39.092275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ac6bd-a7d5-469d-9f60-9182b03387f3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:39.092367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ac6bd-a7d5-469d-9f60-9182b03387f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:39.111006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-951ac6bd-a7d5-469d-9f60-9182b03387f3 None None] MFA Rules not processed for user `71662468e77b43bda5da458a4ddb83c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:39.112208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-951ac6bd-a7d5-469d-9f60-9182b03387f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:39.119332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1098/2188] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:39.222358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:39.224158 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:39.292163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0ef4-5090-4996-a215-01229edb708d service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:39.296981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:39.297741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:39.298052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:39.298353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] PATH_INFO: `/v3/users/a64e87637a114f2b906dd68f8dfdd4b0` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:39.299539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64e87637a114f2b906dd68f8dfdd4b0)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:39.301487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:39.303183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:39.356172 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64e87637a114f2b906dd68f8dfdd4b0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:39.365427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64e87637a114f2b906dd68f8dfdd4b0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:39.366090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64e87637a114f2b906dd68f8dfdd4b0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:39.379058 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64e87637a114f2b906dd68f8dfdd4b0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:39.388541 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64e87637a114f2b906dd68f8dfdd4b0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:39.394813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1091/2189] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:39 2022] DELETE /identity/v3/users/a64e87637a114f2b906dd68f8dfdd4b0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:59:39.399780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:39.400068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:39.400376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:39.420879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:39.422131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:39.484170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1099/2190] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:39.494792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:39.496208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:39.563045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d28826-736b-4e5f-bb6f-d13cd08bafa8 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:39.566663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:39.567821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:39.568096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:39.568363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:39.578457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:39.579908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:39.592840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1092/2191] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:39.978221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:39.979734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:39.997838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d2cb9-608b-4ab1-b4b0-b10e75d589ed None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:40.010598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:40.011257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:40.011564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:40.011843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] PATH_INFO: `/v3/projects/5eac54a57bee4a78a402dd4cb990abd3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:40.016251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eac54a57bee4a78a402dd4cb990abd3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:40.016251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:40.022716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:40.069196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eac54a57bee4a78a402dd4cb990abd3', 'request_id': 'req-9ce36b70-9c42-4a73-bb80-2b27c29085c5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.075417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eac54a57bee4a78a402dd4cb990abd3', 'request_id': 'req-9ce36b70-9c42-4a73-bb80-2b27c29085c5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.083181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eac54a57bee4a78a402dd4cb990abd3', 'request_id': 'req-9ce36b70-9c42-4a73-bb80-2b27c29085c5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.093957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] The token cache is being invalidate because project 5eac54a57bee4a78a402dd4cb990abd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:40.094552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.094875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.096363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1100/2192] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:39 2022] DELETE /identity/v3/projects/5eac54a57bee4a78a402dd4cb990abd3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:40.100758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:40.111959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eab20-3b35-41e1-b084-1d7e92bc12fc service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:40.173604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:40.174236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:40.174518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:40.174794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] PATH_INFO: `/v3/users/f1c0990760334edba4f670c517cd209a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:40.175906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c0990760334edba4f670c517cd209a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:40.178420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:40.200273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:40.225485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c0990760334edba4f670c517cd209a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.232644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c0990760334edba4f670c517cd209a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.233312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c0990760334edba4f670c517cd209a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.245219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c0990760334edba4f670c517cd209a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.251996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c0990760334edba4f670c517cd209a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.257856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1093/2193] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:40 2022] DELETE /identity/v3/users/f1c0990760334edba4f670c517cd209a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:40.524922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:40.526627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:40.541117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce36b70-9c42-4a73-bb80-2b27c29085c5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:40.599792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:40.600353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:40.600631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:40.600903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] PATH_INFO: `/v3/projects/bded0031abc74ffcaad396d5776c7fb6` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:40.602065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bded0031abc74ffcaad396d5776c7fb6)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:40.603986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:40.654168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bded0031abc74ffcaad396d5776c7fb6', 'request_id': 'req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.660751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bded0031abc74ffcaad396d5776c7fb6', 'request_id': 'req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.669644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bded0031abc74ffcaad396d5776c7fb6', 'request_id': 'req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.682562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] The token cache is being invalidate because project bded0031abc74ffcaad396d5776c7fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:40.682955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.683619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.685142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1101/2194] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:40 2022] DELETE /identity/v3/projects/bded0031abc74ffcaad396d5776c7fb6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:40.689480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:40.691189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:40.704763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede282b-caf6-4f3a-9a36-43a8bb57250c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:40.761865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:40.762508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:40.762787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:40.763060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] PATH_INFO: `/v3/users/ea9efd5b69cb41e981536206a6077179` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:40.764201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9efd5b69cb41e981536206a6077179)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:40.773839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:40.825084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9efd5b69cb41e981536206a6077179'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.833593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9efd5b69cb41e981536206a6077179'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.834316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9efd5b69cb41e981536206a6077179'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.849452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9efd5b69cb41e981536206a6077179'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.857060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4c6eee3d-2ee5-4f8f-aa0c-095ac59d80fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9efd5b69cb41e981536206a6077179'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:40.863237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1094/2195] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:40 2022] DELETE /identity/v3/users/ea9efd5b69cb41e981536206a6077179 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:41.219051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.220537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:41.237361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9d2b-7a67-4882-ba6e-2315afd73ed9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.259146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:41.296957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.297624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.297909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.298184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] PATH_INFO: `/v3/projects/1b2be6694d0a4dbcabc986359b088a3f` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.299306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2be6694d0a4dbcabc986359b088a3f)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.301203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.347006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2be6694d0a4dbcabc986359b088a3f', 'request_id': 'req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:41.353702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2be6694d0a4dbcabc986359b088a3f', 'request_id': 'req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:41.361415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2be6694d0a4dbcabc986359b088a3f', 'request_id': 'req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:41.372137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] The token cache is being invalidate because project 1b2be6694d0a4dbcabc986359b088a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:41.372424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:41.373046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c4ac2ec7-5ee2-4782-afcf-fd10bd1ba33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:41.374534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1102/2196] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:41 2022] DELETE /identity/v3/projects/1b2be6694d0a4dbcabc986359b088a3f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:41.379535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.380031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.380143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.399260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:41.400462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:41.414110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:41.461064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1095/2197] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:41.468884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.469163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.469459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.489545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:41.490732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:41.498508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1103/2198] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:41.502631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.512357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059876-aec5-4ee7-af7c-a4e70d427fd5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.516928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.517551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.517837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.518113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.518782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:41.519089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.520701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.532297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1096/2199] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:41.537136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.545822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c003-7a8c-49d0-856d-b58b1b5f04af None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.550397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.550982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.551363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.552147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.552765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.554680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.582151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1104/2200] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:41 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:59:41.586424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.596892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d66ef4-37ce-4267-8e3e-ed516efb2d46 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.653128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.653679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.653961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.654231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.654852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.656771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.678321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1097/2201] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:41 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:41.682388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.692509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a1f2-7da3-4dc5-ad1e-dd626a93c2c3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.697028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.697652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.697926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.698194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.698820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.700378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.710469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1105/2202] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:41.714152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.724683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce56fc-5bda-46c5-a1a5-8178061a5495 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.729432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121e7d0-b251-4591-95d4-3e0fa9d33900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.730017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e7d0-b251-4591-95d4-3e0fa9d33900 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.730297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e7d0-b251-4591-95d4-3e0fa9d33900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.730564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e7d0-b251-4591-95d4-3e0fa9d33900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.731194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121e7d0-b251-4591-95d4-3e0fa9d33900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.732761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121e7d0-b251-4591-95d4-3e0fa9d33900 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.744290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1098/2203] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:41.748331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.758061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e02f2-9fc3-4725-9a49-224dc7c79c5c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:41.762904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:41.763556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.763837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.764111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] PATH_INFO: `/v3/projects/7e402311491649cc9dd2b6668da429ee/users/df0c28d181724a10a3f6d54bbfd339f5/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.779268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e402311491649cc9dd2b6668da429ee, user_id=df0c28d181724a10a3f6d54bbfd339f5, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:41.781947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:41.795284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1106/2204] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:41 2022] PUT /identity/v3/projects/7e402311491649cc9dd2b6668da429ee/users/df0c28d181724a10a3f6d54bbfd339f5/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:59:41.805751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a39028-bdac-4067-be4a-209fdff66a84 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:41.806037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a39028-bdac-4067-be4a-209fdff66a84 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:41.806307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a39028-bdac-4067-be4a-209fdff66a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:41.833616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-63a39028-bdac-4067-be4a-209fdff66a84 None None] MFA Rules not processed for user `df0c28d181724a10a3f6d54bbfd339f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:41.834820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-63a39028-bdac-4067-be4a-209fdff66a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:41.897141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1099/2205] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:41.908822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:41.911370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:41.972325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:41.996848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11adce-a810-4128-bb10-bff4b215b45a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:42.000602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2489d-e426-49d9-bb8b-25e922065e2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:42.001231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2489d-e426-49d9-bb8b-25e922065e2e service glance] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:42.001549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2489d-e426-49d9-bb8b-25e922065e2e service glance] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:42.001803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2489d-e426-49d9-bb8b-25e922065e2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:42.010362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2489d-e426-49d9-bb8b-25e922065e2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:42.011774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2489d-e426-49d9-bb8b-25e922065e2e service glance] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:42.021798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1107/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:46.689326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:46.690215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:46.690899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:46.715546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] MFA Rules not processed for user `d67fb10a8a4a4dc188c3f4e50a277a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:46.717613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:46.728620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:46.794787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1100/2207] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 07:59:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:52.016535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=12 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:56.787972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=18 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:05.330157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75f408-8822-47a9-bd6d-acfb6fa922b6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:05.330618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75f408-8822-47a9-bd6d-acfb6fa922b6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:05.330706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75f408-8822-47a9-bd6d-acfb6fa922b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:05.350874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9b75f408-8822-47a9-bd6d-acfb6fa922b6 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:05.352097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9b75f408-8822-47a9-bd6d-acfb6fa922b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:05.407539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1108/2208] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:00:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:05.454368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:05.455849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:05.524860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75ad1-ef49-4c0e-9d56-c6fc088f263d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:05.530442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:05.531056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:05.531337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:05.531609 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:05.540655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:05.542258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:05.551528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1101/2209] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:06.122915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106ea0-9d9b-43c1-84db-8a3d0284cafa None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:06.123978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106ea0-9d9b-43c1-84db-8a3d0284cafa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:06.124265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106ea0-9d9b-43c1-84db-8a3d0284cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:06.150973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fb106ea0-9d9b-43c1-84db-8a3d0284cafa None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:06.152575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fb106ea0-9d9b-43c1-84db-8a3d0284cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:06.161619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1109/2210] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 08:00:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:06.175338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:06.185939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39154ce-ad1b-45c5-8221-02373c8880bc service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:06.191544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:06.192245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:06.193129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:06.193503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:06.203429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:06.205300 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:06.216152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1102/2211] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:00:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:06.496172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e51c1-a48f-42c0-a169-ababf5417fde None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:06.496649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e51c1-a48f-42c0-a169-ababf5417fde None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:06.496756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e51c1-a48f-42c0-a169-ababf5417fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:06.517053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-011e51c1-a48f-42c0-a169-ababf5417fde None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:06.518559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-011e51c1-a48f-42c0-a169-ababf5417fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:06.526040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1110/2212] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:00:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:06.539086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:06.550611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126b324-5780-431a-98ba-fc3409481d67 service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:06.556630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:06.557584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:06.558012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:06.558469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:06.567289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:06.569929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:06.578992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1103/2213] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:00:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:06.957829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:06.958170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:06.958450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:06.979284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:06.980830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:06.993562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1111/2214] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 08:00:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:00:07.003989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:07.014965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea738a6-e972-4719-9cb8-6f28c812b9cc service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:07.020027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d7d99-bb5a-4435-a403-83909aacb52c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:07.020671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d7d99-bb5a-4435-a403-83909aacb52c service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:07.020946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d7d99-bb5a-4435-a403-83909aacb52c service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:07.021215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d7d99-bb5a-4435-a403-83909aacb52c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:07.030339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d7d99-bb5a-4435-a403-83909aacb52c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:07.032557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d7d99-bb5a-4435-a403-83909aacb52c service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:07.041930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1104/2215] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:00:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:09.229769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:09.231219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:09.298199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af083932-a1b2-4d39-9140-95ce0f693dc6 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:09.303703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:09.304349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:09.304633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:09.304909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] PATH_INFO: `/v3/users/71662468e77b43bda5da458a4ddb83c3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:09.306333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=71662468e77b43bda5da458a4ddb83c3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:09.308111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:09.365204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71662468e77b43bda5da458a4ddb83c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.365866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71662468e77b43bda5da458a4ddb83c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.373336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71662468e77b43bda5da458a4ddb83c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.386231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71662468e77b43bda5da458a4ddb83c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.393006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71662468e77b43bda5da458a4ddb83c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.399438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1112/2216] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:00:09 2022] DELETE /identity/v3/users/71662468e77b43bda5da458a4ddb83c3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:09.404178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:09.404660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:09.404754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:09.425074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:09.426327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:09.490650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1105/2217] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:09.500365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:09.501858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:09.508580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:09.561946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4161-bdd3-440a-9934-027babaf85fb admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:09.565637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:09.566238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:09.566516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:09.566788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:09.575957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:09.577460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:09.588232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1113/2218] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:09.754054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:09.755649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:09.768486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee564c5-6e4a-41aa-91d6-cb170c4dc943 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:09.773933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:09.774577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:09.774889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:09.775191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] PATH_INFO: `/v3/projects/9bf386ec52fb4acea957087600c2a760` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:09.776845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf386ec52fb4acea957087600c2a760)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:09.778821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:09.824641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:09.827782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf386ec52fb4acea957087600c2a760', 'request_id': 'req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.835100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf386ec52fb4acea957087600c2a760', 'request_id': 'req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.842928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf386ec52fb4acea957087600c2a760', 'request_id': 'req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.853781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] The token cache is being invalidate because project 9bf386ec52fb4acea957087600c2a760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:00:09.854197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.854832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f0c2100f-2a0d-49ac-9e9e-a980f1fac923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:09.856358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1106/2219] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:00:09 2022] DELETE /identity/v3/projects/9bf386ec52fb4acea957087600c2a760 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:13.572010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:13.573625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:13.591155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523843-3412-43a8-8e38-3374bd1a6df6 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:13.647275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:13.647900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:13.648179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:13.648453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] PATH_INFO: `/v3/users/df0c28d181724a10a3f6d54bbfd339f5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:13.649593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0c28d181724a10a3f6d54bbfd339f5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:13.651759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:13.696140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0c28d181724a10a3f6d54bbfd339f5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:13.696782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0c28d181724a10a3f6d54bbfd339f5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:13.703805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0c28d181724a10a3f6d54bbfd339f5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:13.716215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0c28d181724a10a3f6d54bbfd339f5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:13.722946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0c28d181724a10a3f6d54bbfd339f5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:13.728811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1114/2220] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:00:13 2022] DELETE /identity/v3/users/df0c28d181724a10a3f6d54bbfd339f5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:13.733251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:13.733737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:13.733919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:13.752069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:13.753249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:13.812084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1107/2221] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:13.822108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:13.823551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:13.854764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:13.883006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827ad61-b9d3-4c2c-a0d4-d215b189f675 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:13.886668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86143a3-e3a8-41dd-b30f-dc7e6f82c24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:13.887269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86143a3-e3a8-41dd-b30f-dc7e6f82c24f service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:13.887547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86143a3-e3a8-41dd-b30f-dc7e6f82c24f service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:13.887818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86143a3-e3a8-41dd-b30f-dc7e6f82c24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:13.897249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86143a3-e3a8-41dd-b30f-dc7e6f82c24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:13.898703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86143a3-e3a8-41dd-b30f-dc7e6f82c24f service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:13.908263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1115/2222] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:14.174126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.175567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:14.188192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031b70-8124-49a0-abf0-3886cba62110 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.193697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.194361 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.194640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.194913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] PATH_INFO: `/v3/projects/7e402311491649cc9dd2b6668da429ee` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.196045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e402311491649cc9dd2b6668da429ee)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.198011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.243670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e402311491649cc9dd2b6668da429ee', 'request_id': 'req-9614ba82-1ca7-4d90-ae05-665f033cf04b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:14.249707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e402311491649cc9dd2b6668da429ee', 'request_id': 'req-9614ba82-1ca7-4d90-ae05-665f033cf04b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:14.257379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e402311491649cc9dd2b6668da429ee', 'request_id': 'req-9614ba82-1ca7-4d90-ae05-665f033cf04b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:14.267514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] The token cache is being invalidate because project 7e402311491649cc9dd2b6668da429ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:00:14.267803 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:14.268434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9614ba82-1ca7-4d90-ae05-665f033cf04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:14.269947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1108/2223] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:00:14 2022] DELETE /identity/v3/projects/7e402311491649cc9dd2b6668da429ee => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:14.274786 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.276995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.279652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.301343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:14.303751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:14.364980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1116/2224] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:14.373629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.373937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.374232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.394723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:14.395927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:14.404002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1109/2225] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:14.408014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.418034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ffc1-8869-45bb-bb6b-344cef22fb46 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.422595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.423187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.423466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.423736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.424373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:00:14.424675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.426298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.438125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1117/2226] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:00:14.442271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.451390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e3b0-8b98-48da-8958-eea1b951ba62 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.456223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.456807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.457085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.457387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.458010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.459932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.486881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1110/2227] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:00:14 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:00:14.491641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.501642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad14dd-8bc5-4771-b1ea-8125aaac7ec7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.556448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.557050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.557365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.557640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.558273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.560143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.580028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1118/2228] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:00:14 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:00:14.584317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.594777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2acb-76e4-4f40-a818-178fefb1fe85 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.600099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.600697 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.600977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.601247 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.602067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.603650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.614901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1111/2229] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:00:14.618845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.628593 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041112bd-07cc-472f-aeb8-cd007116a71d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.633166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3f75e-416b-46ac-894a-081b5856fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.633789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3f75e-416b-46ac-894a-081b5856fc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.634066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3f75e-416b-46ac-894a-081b5856fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.634338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3f75e-416b-46ac-894a-081b5856fc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.634974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3f75e-416b-46ac-894a-081b5856fc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.636544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3f75e-416b-46ac-894a-081b5856fc88 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.647418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1119/2230] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:00:14.651209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.661971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7944-3651-401c-8d66-80e904a8ee30 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.666599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.667328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.667687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.668001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] PATH_INFO: `/v3/projects/d8ea3d71bfd149da9818558733bd9f44/users/ef9a917b53314f6aa4053d860351b14b/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.682229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ea3d71bfd149da9818558733bd9f44, user_id=ef9a917b53314f6aa4053d860351b14b, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.684852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.687057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:14.700355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1112/2231] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:00:14 2022] PUT /identity/v3/projects/d8ea3d71bfd149da9818558733bd9f44/users/ef9a917b53314f6aa4053d860351b14b/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:14.711078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.711365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.711663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.739313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] MFA Rules not processed for user `ef9a917b53314f6aa4053d860351b14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:14.740531 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:14.763503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:14.805451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1120/2232] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:14.816648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:14.818351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:14.873622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a4f3-48db-4b41-a931-45f317033533 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:14.877086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98d876-3cc6-45f5-b564-6e4258b4e6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:14.877704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98d876-3cc6-45f5-b564-6e4258b4e6ef service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:14.877981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98d876-3cc6-45f5-b564-6e4258b4e6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:14.878249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98d876-3cc6-45f5-b564-6e4258b4e6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:14.886241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98d876-3cc6-45f5-b564-6e4258b4e6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:14.887644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98d876-3cc6-45f5-b564-6e4258b4e6ef service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:14.896739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1113/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:19.847806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:19.909237 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e31b-b10b-4ed2-9d04-46d3ff08e628 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:19.913841 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:19.914462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:19.914746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:19.915018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] PATH_INFO: `/v3/users/ef9a917b53314f6aa4053d860351b14b` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:19.916125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9a917b53314f6aa4053d860351b14b)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:19.918109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:19.962901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9a917b53314f6aa4053d860351b14b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:19.963535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9a917b53314f6aa4053d860351b14b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:19.970658 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9a917b53314f6aa4053d860351b14b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:19.982221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9a917b53314f6aa4053d860351b14b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:19.988900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9a917b53314f6aa4053d860351b14b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:19.995118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1121/2234] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:00:19 2022] DELETE /identity/v3/users/ef9a917b53314f6aa4053d860351b14b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:19.999580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.000060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.000175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.019653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:20.020885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.077364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1114/2235] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:20.086936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.088308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.133980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:20.145672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa377bbe-3aa8-452b-9a2c-9168aad7d963 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.149575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61872-c780-4510-8fb2-fed54a6f294b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.150203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61872-c780-4510-8fb2-fed54a6f294b service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.150483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61872-c780-4510-8fb2-fed54a6f294b service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.150753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61872-c780-4510-8fb2-fed54a6f294b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.159882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b61872-c780-4510-8fb2-fed54a6f294b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.161318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b61872-c780-4510-8fb2-fed54a6f294b service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.170548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1122/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:20.441946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.443622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.456478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1df65-149f-4eb3-874a-2834f42baa55 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.461820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.462732 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.463045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.463318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] PATH_INFO: `/v3/projects/d8ea3d71bfd149da9818558733bd9f44` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.464537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ea3d71bfd149da9818558733bd9f44)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.466348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.512911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ea3d71bfd149da9818558733bd9f44', 'request_id': 'req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:20.518948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ea3d71bfd149da9818558733bd9f44', 'request_id': 'req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:20.526070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ea3d71bfd149da9818558733bd9f44', 'request_id': 'req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:20.536982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] The token cache is being invalidate because project d8ea3d71bfd149da9818558733bd9f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:00:20.537293 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:20.537916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d8ff53f3-cd9e-4ea8-a25f-577855ac730e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:00:20.539363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1115/2237] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:00:20 2022] DELETE /identity/v3/projects/d8ea3d71bfd149da9818558733bd9f44 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:20.544184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.544497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.544771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.565474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:20.566670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.624284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1123/2238] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:20.633131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.633464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.633742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.653692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:20.654890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.663426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1116/2239] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:20.667475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.676979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1196-cbc1-4c39-b9d0-ac94c7781d34 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.681525 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.682106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.682380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.682639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.683270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:00:20.683564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.685134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.700318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1124/2240] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:00:20.704565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.714346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754f4c4-2a9e-409a-beb0-89ee06871161 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.719188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.719774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.720048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.720314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.720923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.722873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.734707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:20.751085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1117/2241] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:00:20 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:00:20.755136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.765712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a71e8-25da-4ae5-a196-c888f1bb0d1e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.822153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.822750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.823024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.823291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.823898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.825823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.846631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1125/2242] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:00:20 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:00:20.851298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.861789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e694-150d-4f13-af5e-458ff102b058 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.866485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.867079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.867358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.867628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.868289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.869891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.879664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1118/2243] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:00:20.883461 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.893153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f25b-7eba-41c4-96f0-e88894381a13 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.898267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c5d7b-3acc-4298-b2fb-33551a70040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.898858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5d7b-3acc-4298-b2fb-33551a70040b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.899134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5d7b-3acc-4298-b2fb-33551a70040b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.899404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5d7b-3acc-4298-b2fb-33551a70040b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.900057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c5d7b-3acc-4298-b2fb-33551a70040b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.901924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c5d7b-3acc-4298-b2fb-33551a70040b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.913172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1126/2244] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:00:20.917161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.926955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd276c-70b6-4ee2-8bd5-39e6d289671d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.931547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.932180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.932460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.932733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] PATH_INFO: `/v3/projects/30fb1a968f1b45439918c2a1e0497d11/users/9868d0d20b2e4716a4befbbcef40e26c/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.946879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fb1a968f1b45439918c2a1e0497d11, user_id=9868d0d20b2e4716a4befbbcef40e26c, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.949557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:20.963739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1119/2245] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:00:20 2022] PUT /identity/v3/projects/30fb1a968f1b45439918c2a1e0497d11/users/9868d0d20b2e4716a4befbbcef40e26c/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:20.968667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af7fe-e16a-419d-8c67-fd9e3fdb960d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.968955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af7fe-e16a-419d-8c67-fd9e3fdb960d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.969274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af7fe-e16a-419d-8c67-fd9e3fdb960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.988188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-919af7fe-e16a-419d-8c67-fd9e3fdb960d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:20.989410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-919af7fe-e16a-419d-8c67-fd9e3fdb960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:21.035443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:21.048555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1127/2246] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:21.058107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:21.059882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:21.117115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286a15-8354-4258-a100-4474e1fe050d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:21.120795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:21.121426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:21.121708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:21.122002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:21.131551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:21.132905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:21.142314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1120/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:24.918991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:24.919458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:24.919674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:24.953110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] MFA Rules not processed for user `9868d0d20b2e4716a4befbbcef40e26c`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:24.956481 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:25.025916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1128/2248] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:25.030434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:25.040221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e534c7-9cd7-4e8b-9c58-d4cb0e79b4e7 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:25.045001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:25.045723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:25.046095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:25.046441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:25.047077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:25.049006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:25.076882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1121/2249] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:00:25 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:00:25.080680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:25.092696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db3ac-abf9-4f94-bfd6-f56fd96c9a67 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:25.175622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:25.176169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:25.176487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:25.176766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:25.177976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:25.179934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:25.202840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1129/2250] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:00:25 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:00:25.206990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:25.218055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b9bdb-a723-410b-8913-0e8edb4de1bb admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:25.223113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:25.223816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:25.224095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:25.224366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:25.225012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:25.226653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:25.238405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1122/2251] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:00:25.243275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:25.253793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a862a-add4-47fe-a56e-847513396486 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:25.258629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:25.259293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:25.259568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:25.259836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] PATH_INFO: `/v3/projects/9276db12d05541fb84093612b02d1367/users/3a87f9fb72e24829a9d81c7e00fe660d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:25.277527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9276db12d05541fb84093612b02d1367, user_id=3a87f9fb72e24829a9d81c7e00fe660d, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:25.280301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:25.293622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1130/2252] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:00:25 2022] PUT /identity/v3/projects/9276db12d05541fb84093612b02d1367/users/3a87f9fb72e24829a9d81c7e00fe660d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:00:25.297751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:25.308779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd94-bab1-4b15-908f-518eae04c84d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:25.375424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099dc32-4e69-4be3-8b4b-882c5b136edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:25.375945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099dc32-4e69-4be3-8b4b-882c5b136edf admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:25.376225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099dc32-4e69-4be3-8b4b-882c5b136edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:25.376495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099dc32-4e69-4be3-8b4b-882c5b136edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:25.377134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099dc32-4e69-4be3-8b4b-882c5b136edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:25.378767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099dc32-4e69-4be3-8b4b-882c5b136edf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:25.389566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1123/2253] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:00:25.393852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:25.405449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb7bcb-3463-46bc-9063-07c632d919a7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:25.410292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:25.410961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:25.411288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:25.412286 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] PATH_INFO: `/v3/projects/9276db12d05541fb84093612b02d1367/users/3a87f9fb72e24829a9d81c7e00fe660d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:25.414232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9276db12d05541fb84093612b02d1367, user_id=3a87f9fb72e24829a9d81c7e00fe660d, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:25.416844 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:25.427898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1131/2254] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:00:25 2022] PUT /identity/v3/projects/9276db12d05541fb84093612b02d1367/users/3a87f9fb72e24829a9d81c7e00fe660d/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:00:29.516051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eab1f-923c-4cd1-be3a-b03a68f09b42 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:29.516572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eab1f-923c-4cd1-be3a-b03a68f09b42 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:29.516670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eab1f-923c-4cd1-be3a-b03a68f09b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:29.546094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6e1eab1f-923c-4cd1-be3a-b03a68f09b42 None None] MFA Rules not processed for user `3a87f9fb72e24829a9d81c7e00fe660d`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:29.547385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6e1eab1f-923c-4cd1-be3a-b03a68f09b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:29.557166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:29.641821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1124/2255] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:29.655311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:29.660008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:29.703089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:29.722374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ca5ff-8764-47a3-a503-7880cba7fa47 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:29.726040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:29.726660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:29.726943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:29.727218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:29.786998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:29.788429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:29.797328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1132/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:29.937510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef65fb-a68f-4208-9759-cdf2e8a8e16a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:29.937801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef65fb-a68f-4208-9759-cdf2e8a8e16a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:29.938117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef65fb-a68f-4208-9759-cdf2e8a8e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:29.960271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-22ef65fb-a68f-4208-9759-cdf2e8a8e16a None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:29.961555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-22ef65fb-a68f-4208-9759-cdf2e8a8e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:30.057218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1125/2257] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:00:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:30.070077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:30.071554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:30.157201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635d32b-db88-4854-ba8a-1311b133e665 service glance] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:30.163413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39246dfe-2157-42dd-a027-bf7ad9ab451c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:30.163866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39246dfe-2157-42dd-a027-bf7ad9ab451c service swift] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:30.164150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39246dfe-2157-42dd-a027-bf7ad9ab451c service swift] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:30.164427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39246dfe-2157-42dd-a027-bf7ad9ab451c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:30.175196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39246dfe-2157-42dd-a027-bf7ad9ab451c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:30.178322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39246dfe-2157-42dd-a027-bf7ad9ab451c service swift] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:30.187324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1133/2258] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:00:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:40.043427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=49 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:40.078873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e0a34-e3ef-4f1d-a5ec-4f9d6f69dcce None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:40.079163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e0a34-e3ef-4f1d-a5ec-4f9d6f69dcce None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:40.079437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e0a34-e3ef-4f1d-a5ec-4f9d6f69dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:40.101010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-926e0a34-e3ef-4f1d-a5ec-4f9d6f69dcce None None] MFA Rules not processed for user `39d380ad69d9417a86f88f45341b68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:40.102408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-926e0a34-e3ef-4f1d-a5ec-4f9d6f69dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:40.184691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=64 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:40.201231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1126/2259] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:40.439680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:40.439965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:40.440240 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:40.459347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] MFA Rules not processed for user `9868d0d20b2e4716a4befbbcef40e26c`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:40.460656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:40.469306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1134/2260] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:00:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:43.254407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835a29-8c60-41d4-b8ec-8641dcf8f5cc None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:43.254900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835a29-8c60-41d4-b8ec-8641dcf8f5cc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:43.254996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835a29-8c60-41d4-b8ec-8641dcf8f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:43.274228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4e835a29-8c60-41d4-b8ec-8641dcf8f5cc None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:43.275432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4e835a29-8c60-41d4-b8ec-8641dcf8f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:43.283181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1127/2261] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:00:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:43.297515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:43.311197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1794ab-cd0e-412a-99d1-3502b5cf97bd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:43.316083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:43.316690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:43.317022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:43.317311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:43.325922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:43.327512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:43.336227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1135/2262] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:00:53.268419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=28 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:53.332821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=9 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:08.840142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:08.840658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:08.840658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:08.860910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:08.862335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:08.869500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1128/2263] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:08.891715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:08.902941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5df4ff-dde6-4187-944d-33edb3db1036 service swift] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:08.907939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:08.908605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:08.908948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:08.909410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:08.918415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:08.920048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:08.928483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1136/2264] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:01:18.693990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:18.783457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d21f7-e443-4253-b0e2-fb7eda7e24a7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:18.790049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5898d6-f9f4-4707-b5f4-f9a3d04b93b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:18.790816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5898d6-f9f4-4707-b5f4-f9a3d04b93b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:18.791723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5898d6-f9f4-4707-b5f4-f9a3d04b93b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:18.792106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5898d6-f9f4-4707-b5f4-f9a3d04b93b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:18.806978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5898d6-f9f4-4707-b5f4-f9a3d04b93b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:18.808604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5898d6-f9f4-4707-b5f4-f9a3d04b93b7 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:18.823462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1129/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:18.925063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=6 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:24.545867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:24.548570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:24.627276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5af6f-4837-4ff8-95f2-24a5c6caeea6 service swift] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:24.633543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:24.634820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:24.635108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:24.635383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:24.637306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:24.651062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:24.653070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff378b-fc69-4b00-8d96-182513b9e073 service placement] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:24.664187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1137/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:26.538395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5020ca-cf62-4798-b4b9-599dd1fda00d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.539014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5020ca-cf62-4798-b4b9-599dd1fda00d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.539014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5020ca-cf62-4798-b4b9-599dd1fda00d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.540316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1130/2267] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 08:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:26.546374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac407c-5734-427f-a77b-a43d70f63b7f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.546835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac407c-5734-427f-a77b-a43d70f63b7f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.546934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac407c-5734-427f-a77b-a43d70f63b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.567760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e1ac407c-5734-427f-a77b-a43d70f63b7f None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:26.568975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e1ac407c-5734-427f-a77b-a43d70f63b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:26.639166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1138/2268] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 08:01:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:01:26.651533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5020ca-cf62-4798-b4b9-599dd1fda00d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:26.653681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1d5020ca-cf62-4798-b4b9-599dd1fda00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:26.667851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5020ca-cf62-4798-b4b9-599dd1fda00d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:26.672656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af005b1-c16b-4a03-86b6-31634673bfe7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:26.673383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af005b1-c16b-4a03-86b6-31634673bfe7 service glance] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.673730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af005b1-c16b-4a03-86b6-31634673bfe7 service glance] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.674066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af005b1-c16b-4a03-86b6-31634673bfe7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.684645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af005b1-c16b-4a03-86b6-31634673bfe7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:26.686066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af005b1-c16b-4a03-86b6-31634673bfe7 service glance] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:26.696507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1131/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:26.766883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea597-4083-43c9-84a2-7e36cdb3f448 None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.767098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea597-4083-43c9-84a2-7e36cdb3f448 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.767350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea597-4083-43c9-84a2-7e36cdb3f448 None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.769185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1139/2270] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 08:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:26.774253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df222-551c-4785-8302-5f398d305ae5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.774551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df222-551c-4785-8302-5f398d305ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.774831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df222-551c-4785-8302-5f398d305ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.795142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-cf9df222-551c-4785-8302-5f398d305ae5 None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:26.796392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cf9df222-551c-4785-8302-5f398d305ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:26.803082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1132/2271] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 08:01:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:26.814646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea597-4083-43c9-84a2-7e36cdb3f448 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:26.825543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea597-4083-43c9-84a2-7e36cdb3f448 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:26.829061 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1440f-4b44-4a70-9fd3-8f608f37d0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:26.829683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1440f-4b44-4a70-9fd3-8f608f37d0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.829957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1440f-4b44-4a70-9fd3-8f608f37d0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.830230 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1440f-4b44-4a70-9fd3-8f608f37d0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.837678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1440f-4b44-4a70-9fd3-8f608f37d0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:26.839085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1440f-4b44-4a70-9fd3-8f608f37d0d5 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:26.847318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1140/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:26.931604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20910-c482-4e45-bd22-3964f5a93526 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.931894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20910-c482-4e45-bd22-3964f5a93526 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.932168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20910-c482-4e45-bd22-3964f5a93526 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.933543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1133/2273] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 08:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:26.938278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665b83-8f28-4eeb-be82-a69cd5381adc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.938562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665b83-8f28-4eeb-be82-a69cd5381adc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.938837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665b83-8f28-4eeb-be82-a69cd5381adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:26.958418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-81665b83-8f28-4eeb-be82-a69cd5381adc None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:26.959599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-81665b83-8f28-4eeb-be82-a69cd5381adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:26.968569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1141/2274] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 08:01:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:26.979508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e20910-c482-4e45-bd22-3964f5a93526 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:26.991343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e20910-c482-4e45-bd22-3964f5a93526 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:26.994904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:26.995500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:26.995780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:26.996050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:27.006661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:27.008078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:27.019227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1134/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:29.407845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202ff8-cccd-4f59-a9a5-66bd10fe5ed2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:29.408306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202ff8-cccd-4f59-a9a5-66bd10fe5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:29.408430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202ff8-cccd-4f59-a9a5-66bd10fe5ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:29.427250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2a202ff8-cccd-4f59-a9a5-66bd10fe5ed2 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:29.428450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2a202ff8-cccd-4f59-a9a5-66bd10fe5ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:29.435543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1142/2276] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:01:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:29.447684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:29.459325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d665aa-c9ab-46aa-85e0-9ca9ffd34432 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:29.464325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:29.464914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:29.465198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:29.465627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:29.473535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:29.475103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:29.483037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1135/2277] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:01:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:01:39.422684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=75 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:39.479852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=50 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:57.234266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b86c-c5a5-4ea8-b2be-c8602be87a8c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:57.234822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b86c-c5a5-4ea8-b2be-c8602be87a8c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:57.234822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b86c-c5a5-4ea8-b2be-c8602be87a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:57.253178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-bb81b86c-c5a5-4ea8-b2be-c8602be87a8c None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:57.254946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-bb81b86c-c5a5-4ea8-b2be-c8602be87a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:57.261965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1143/2278] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 08:01:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:57.274717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:57.285304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4785b-537b-4722-9448-8c01f3bb087c service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:57.290213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:57.290793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:57.291068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:57.291338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:57.299061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:57.300610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:57.308477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1136/2279] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:02:07.248595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:07.305437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=6 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:11.839058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:11.839574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:11.839574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:11.858302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] MFA Rules not processed for user `d67fb10a8a4a4dc188c3f4e50a277a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:11.859410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:11.912650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1144/2280] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:02:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:21.905640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=25 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:38.609042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:38.610451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:38.622385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30e85d-c37f-4812-9023-d5737043d8a5 service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:38.625926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:38.626508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:38.626785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:38.627054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:38.628760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:38.642135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:38.644106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:38.656043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1137/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:39.883248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:39.892589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd660e85-4a30-4499-bade-c6f7b36e27ec None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:39.896138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:39.896730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:39.897010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:39.897311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:39.899009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:39.912707 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:39.914177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:39.925630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1145/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:48.650403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=6 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:49.920245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=6 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:02.773112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:02.775193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.788829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c853535-0cea-42b3-bdfb-9b3f73ed543c service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:02.794414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:02.795002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.795281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.795554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.797204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.807638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:02.809200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f24c3-5a19-4c67-9dd1-f77b13253982 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:02.818597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1138/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:06.283527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:06.285646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:06.299690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80108241-127c-4941-abf9-290fb099d5d7 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:06.305465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:06.306074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.306348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.307154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.308479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:06.390238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:06.392298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:06.406549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1146/2284] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:12.813916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=6 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:16.398295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=28 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:17.337861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.338387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.338491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.358332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] MFA Rules not processed for user `412a8703f2d44e95ab52d655316404bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:17.359551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.367281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1139/2285] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:17.789782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:17.798971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b4a88-5cf6-4bea-a6c7-dabaf06c2bcf service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:17.803138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:17.803738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.804013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.804282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.806040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.816378 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:17.817826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2bc73-dc1b-48de-b850-d9dd0619a403 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:17.826167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1147/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:18.281442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:18.295869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbfe06-e32f-4b67-9f65-f56a59db6e56 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:18.301327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:18.302144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:18.302920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:18.309683 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:18.311713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:18.330465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:18.332751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:18.343999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1140/2287] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:19.706453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:19.707034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:19.707133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:19.727687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] MFA Rules not processed for user `39d380ad69d9417a86f88f45341b68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:19.728894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:19.735834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1148/2288] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:20.227797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:20.238179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223323e-1ddb-404d-874e-f3c20d37971a service placement] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:20.241898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:20.242504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.242788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.243063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.244820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:20.254802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:20.256245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:20.264544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1141/2289] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:20.814290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:20.837533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6ce7e-9ca4-46e9-b92c-b18172f7d577 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:20.850678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:20.851313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.851806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.852137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.854005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:20.864478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:20.865957 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:20.875265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1149/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:21.475043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:21.491232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db683cdf-5e96-4ce0-8a7f-cba67ed32367 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:21.497177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:21.497825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:21.498266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:21.498690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:21.500458 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:21.519776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:21.522493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:21.534283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1142/2291] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:24.359697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.361163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:24.425137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a1769-068f-447e-95e8-449d2e1fc9d8 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.428123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.428804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.429187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.430565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.432197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:24.451878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.453416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.462820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1150/2292] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:29.675800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:29.687943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c307-d51d-4a3a-b542-16e453a23b5a service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:29.697714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:29.698866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:29.699488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:29.699931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:29.702203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.734603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:29.736291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:29.747874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1143/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:34.458485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=41 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:39.743336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=27 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:48.767782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:48.777327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98176-9f15-470f-85c4-a49182222850 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:48.780929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:48.781552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:48.781829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:48.782098 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:48.783789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:48.844912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:48.846426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:48.856022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1151/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:52.014246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.015703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:52.030442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d0701-d3ff-45fe-953d-6a75018d29fc service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.035102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.035866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.036156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.036461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] PATH_INFO: `/v3/users/d67fb10a8a4a4dc188c3f4e50a277a83` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.037606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67fb10a8a4a4dc188c3f4e50a277a83)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.039520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.085904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67fb10a8a4a4dc188c3f4e50a277a83'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.093448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67fb10a8a4a4dc188c3f4e50a277a83'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.094087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67fb10a8a4a4dc188c3f4e50a277a83'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.105972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67fb10a8a4a4dc188c3f4e50a277a83'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.113388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-9e6f404e-a812-482e-91c9-ef9faaf66825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67fb10a8a4a4dc188c3f4e50a277a83'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.119325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1144/2295] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:52 2022] DELETE /identity/v3/users/d67fb10a8a4a4dc188c3f4e50a277a83 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:52.300032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.311983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48efe5-1865-49d7-bf2d-f94344363fcc service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.376001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.376802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.377086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.377396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] PATH_INFO: `/v3/projects/df48207a33bf4299a4e35a16879071f8` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.378514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df48207a33bf4299a4e35a16879071f8)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.380413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.425899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df48207a33bf4299a4e35a16879071f8', 'request_id': 'req-cf3021fe-b45e-4415-836e-7e2cd160a48a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.431818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df48207a33bf4299a4e35a16879071f8', 'request_id': 'req-cf3021fe-b45e-4415-836e-7e2cd160a48a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.440434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df48207a33bf4299a4e35a16879071f8', 'request_id': 'req-cf3021fe-b45e-4415-836e-7e2cd160a48a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.450891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] The token cache is being invalidate because project df48207a33bf4299a4e35a16879071f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:52.451181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.451804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-cf3021fe-b45e-4415-836e-7e2cd160a48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:52.453333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1152/2296] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:52 2022] DELETE /identity/v3/projects/df48207a33bf4299a4e35a16879071f8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:52.458380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.458662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.458955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.478504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:52.479698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:52.536911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1145/2297] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:52.544404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.544692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.544971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.564904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:52.566149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:52.574041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1153/2298] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:52.578231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.587809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fccdf-7f90-4c59-8a67-147087b0ed8c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.592349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.592940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.593221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.593522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.594161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:52.594464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.596573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.607871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1146/2299] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:52.612552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.621734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db25fb-2885-4baf-8b9a-b91e5db8da83 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.626342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.626927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.627203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.627470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.628084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.630043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.645140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:52.659431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1154/2300] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:52 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:52.663490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.673407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3ed08-d1a9-4f77-ab57-53514b55206f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.729097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.729728 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.730017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.730291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.730915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.732843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.740504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:52.756967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1147/2301] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:52 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:52.758364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.768569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743da46-6407-4d8f-bfb1-d259e69a4cd1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.773146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.773775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.774059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.774337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.774974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.776578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.787089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1155/2302] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:52.790685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.807655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9607b5-0dcf-4d87-b290-5bade0e606ba admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.812898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413891d-20f2-41e8-aba8-9120aeb10707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.813539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413891d-20f2-41e8-aba8-9120aeb10707 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.814642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413891d-20f2-41e8-aba8-9120aeb10707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.814642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413891d-20f2-41e8-aba8-9120aeb10707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.815387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413891d-20f2-41e8-aba8-9120aeb10707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.816965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413891d-20f2-41e8-aba8-9120aeb10707 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.827900 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1148/2303] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:52.832097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.842225 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f8f7-dc9c-40a0-b22f-82179bb07151 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:52.846810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:52.847465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.847747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.848023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] PATH_INFO: `/v3/projects/762f96abaf8a4e8480dfa16d5ce451f7/users/e688a281ec4e446ebe63bc88469f7eff/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.862666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762f96abaf8a4e8480dfa16d5ce451f7, user_id=e688a281ec4e446ebe63bc88469f7eff, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:52.865321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:52.878246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1156/2304] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:52 2022] PUT /identity/v3/projects/762f96abaf8a4e8480dfa16d5ce451f7/users/e688a281ec4e446ebe63bc88469f7eff/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:52.888235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:52.888524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:52.888797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:52.917075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] MFA Rules not processed for user `e688a281ec4e446ebe63bc88469f7eff`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:52.918325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:52.982188 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1149/2305] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:52.994113 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:52.995791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:53.069564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12316-6dfd-4027-9318-c217de82e552 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:53.075082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343fd1-ee9f-4f05-bb4e-65e600c67df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:53.075686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343fd1-ee9f-4f05-bb4e-65e600c67df8 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:53.076000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343fd1-ee9f-4f05-bb4e-65e600c67df8 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:53.076283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343fd1-ee9f-4f05-bb4e-65e600c67df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:53.084393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343fd1-ee9f-4f05-bb4e-65e600c67df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:53.086018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343fd1-ee9f-4f05-bb4e-65e600c67df8 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:53.094695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1157/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:55.754318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:55.814515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dd309-f302-48cb-8bc5-15f0ced49cac None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:55.819019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:55.819638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:55.819920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:55.820196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] PATH_INFO: `/v3/users/e688a281ec4e446ebe63bc88469f7eff` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:55.821344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e688a281ec4e446ebe63bc88469f7eff)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:55.823248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:55.868028 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e688a281ec4e446ebe63bc88469f7eff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:55.875747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e688a281ec4e446ebe63bc88469f7eff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:55.876976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e688a281ec4e446ebe63bc88469f7eff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:55.887786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.888946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e688a281ec4e446ebe63bc88469f7eff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:55.898092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e688a281ec4e446ebe63bc88469f7eff'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:55.904450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1150/2307] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:55 2022] DELETE /identity/v3/users/e688a281ec4e446ebe63bc88469f7eff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:55.908895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:55.909385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:55.909495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:55.929062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:55.930312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:55.987615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1158/2308] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:55.997366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:55.998824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:56.055445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935db6b-e26b-45da-abdd-9a8d0d2d3304 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.059216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d028-14da-445d-a2eb-aadf103dc1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.059835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d028-14da-445d-a2eb-aadf103dc1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.060112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d028-14da-445d-a2eb-aadf103dc1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.060381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d028-14da-445d-a2eb-aadf103dc1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.069845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d028-14da-445d-a2eb-aadf103dc1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.071249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d028-14da-445d-a2eb-aadf103dc1a1 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.080908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1151/2309] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:56.344602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.349515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:56.357912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1cbc7-1323-4332-9a53-5418a2910635 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.362473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.363111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.363388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.363659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] PATH_INFO: `/v3/projects/762f96abaf8a4e8480dfa16d5ce451f7` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.364758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762f96abaf8a4e8480dfa16d5ce451f7)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.366674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.409341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:56.417236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762f96abaf8a4e8480dfa16d5ce451f7', 'request_id': 'req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:56.423546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762f96abaf8a4e8480dfa16d5ce451f7', 'request_id': 'req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:56.430813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762f96abaf8a4e8480dfa16d5ce451f7', 'request_id': 'req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:56.442124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] The token cache is being invalidate because project 762f96abaf8a4e8480dfa16d5ce451f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:56.442538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:56.443190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-561d97cd-0aaa-4aa7-8e7d-c9434171e6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:56.444655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1159/2310] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:56 2022] DELETE /identity/v3/projects/762f96abaf8a4e8480dfa16d5ce451f7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:56.449715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.450003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.450365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.470200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:56.471388 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:56.528824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1152/2311] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:56.536638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.536920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.537192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.556960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:56.558119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:56.566393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1160/2312] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:56.570455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.580005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e913429-7809-4d24-abf5-b73edb91c4a0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.584579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.585166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.585484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.585757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.586397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:56.586698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.588295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.599781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1153/2313] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:56.603864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.613512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19417a-8ec5-4e25-9116-8eaa53b8b764 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.618089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.618697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.618976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.619245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.619898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.621820 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.649968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1161/2314] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:56 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:56.654186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.663910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d0f89-c411-422f-b515-f0046178ab3e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.719514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.720693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.720972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.721402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.722026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.723951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.746575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1154/2315] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:56 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:56.750656 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.761041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d3476-0b54-4533-a047-7e050b28b19d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.766072 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.766758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.767622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.767902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.768653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.770157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.781001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1162/2316] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:56.785604 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.795614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991fe71-827e-44ae-9903-eeef6c0d6021 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.800148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac603ff-fbef-4e44-8cce-ffeaad6182c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.800743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac603ff-fbef-4e44-8cce-ffeaad6182c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.801026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac603ff-fbef-4e44-8cce-ffeaad6182c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.801329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac603ff-fbef-4e44-8cce-ffeaad6182c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.801971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac603ff-fbef-4e44-8cce-ffeaad6182c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.803655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac603ff-fbef-4e44-8cce-ffeaad6182c4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.804898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:56.815862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1155/2317] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:56.819423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:56.831458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679d743-1c63-40be-9f0e-32f05905cf3e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:56.836153 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:56.836801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.837110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.837420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] PATH_INFO: `/v3/projects/ec4ae6b819f24ff79ea93f25097e31e9/users/885b6caf711f4a62a55bbc7c5334cca5/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.851871 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4ae6b819f24ff79ea93f25097e31e9, user_id=885b6caf711f4a62a55bbc7c5334cca5, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:56.854776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:56.868212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1163/2318] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:56 2022] PUT /identity/v3/projects/ec4ae6b819f24ff79ea93f25097e31e9/users/885b6caf711f4a62a55bbc7c5334cca5/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:56.880795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:56.881093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:56.881401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:56.910686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] MFA Rules not processed for user `885b6caf711f4a62a55bbc7c5334cca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:56.911896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:56.974564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1156/2319] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:56.979234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.040085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659aa39a-cd3a-4358-a42a-041c6c56ceb0 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.044693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.045312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.045602 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.045875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.046492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.048377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.074257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1164/2320] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:56 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:57.078296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.089464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d2e4-6269-42a3-8062-d1cb3ea060f3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.143937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.144531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.144813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.145085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.145759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.147638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.167983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1157/2321] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:57 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:57.171974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.182044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b97a1-05ab-43a9-baf3-365e8748cda9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.186628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.187216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.187492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.187761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.188390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.190498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.200682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1165/2322] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:57.204537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.214933 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3be2-5c3e-48f6-b7ce-248b4621d91a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.219703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.220369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.220652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.220927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] PATH_INFO: `/v3/projects/a41b7e0a49e845e3b406582642ff3913/users/e6152a18c5594d61b303b095f1f4e7c1/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.235333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b7e0a49e845e3b406582642ff3913, user_id=e6152a18c5594d61b303b095f1f4e7c1, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.238049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.252283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1158/2323] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:57 2022] PUT /identity/v3/projects/a41b7e0a49e845e3b406582642ff3913/users/e6152a18c5594d61b303b095f1f4e7c1/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:57.256269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.266158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af07b04-d2ca-4988-b60c-c92abe36606c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.304652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:57.324733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3c38-7692-4336-a9c9-f2015d4a430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.325368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3c38-7692-4336-a9c9-f2015d4a430a admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.325651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3c38-7692-4336-a9c9-f2015d4a430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.325923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3c38-7692-4336-a9c9-f2015d4a430a admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.326551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f3c38-7692-4336-a9c9-f2015d4a430a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.328132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f3c38-7692-4336-a9c9-f2015d4a430a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.337788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1166/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:57.341978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.352360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c908fe6-62b9-484c-b4bc-7d26b2a1785c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.357432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.358084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.358366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.358640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] PATH_INFO: `/v3/projects/a41b7e0a49e845e3b406582642ff3913/users/e6152a18c5594d61b303b095f1f4e7c1/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.361057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b7e0a49e845e3b406582642ff3913, user_id=e6152a18c5594d61b303b095f1f4e7c1, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.363695 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.374374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1159/2325] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:57 2022] PUT /identity/v3/projects/a41b7e0a49e845e3b406582642ff3913/users/e6152a18c5594d61b303b095f1f4e7c1/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:57.385106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.385445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.385723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.413624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] MFA Rules not processed for user `e6152a18c5594d61b303b095f1f4e7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:57.414833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:57.480926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1167/2326] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:03:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:57.492447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.494171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:57.536668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:57.552894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039a2db-92ec-4758-b6dc-a8c4797bc2ce admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.556630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.557166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.557478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.557750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.568787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.570534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.580789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1160/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:57.653804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.663743 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272579-3c0a-4541-95b7-06e70effe073 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.667306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f2c3-6bcd-4bce-8a6d-72cd8412a7db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.667896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f2c3-6bcd-4bce-8a6d-72cd8412a7db service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.668172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f2c3-6bcd-4bce-8a6d-72cd8412a7db service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.668440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f2c3-6bcd-4bce-8a6d-72cd8412a7db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.722697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f2c3-6bcd-4bce-8a6d-72cd8412a7db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.724126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f2c3-6bcd-4bce-8a6d-72cd8412a7db service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.733253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1168/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:00.232356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.233791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.244821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fd8df-5df4-4e57-b494-8fd29e88845f service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.248411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.248996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.249307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.249590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.251734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.312710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.314781 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:00.324162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1161/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:06.192152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:06.192647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:06.192855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:06.213081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] MFA Rules not processed for user `e8e5a0df4ec54ab495a007f8804f23b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:06.214346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:06.222968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1169/2330] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:10.320644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=37 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:16.208418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=76 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:22.277454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:22.278881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:22.377344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29948f-c99c-4eb8-a081-cf4290c7f23a service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:22.388664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:22.389463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:22.389848 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:22.390258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:22.392633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:22.409738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:22.412271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a491f1-0e74-451f-bd10-b55847316ac6 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:22.429586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1162/2331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:29.281918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:29.369054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed3be-1a41-490d-be55-2a9b70b16931 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:29.373950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:29.374619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:29.374963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:29.375244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] PATH_INFO: `/v3/users/885b6caf711f4a62a55bbc7c5334cca5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:29.376434 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885b6caf711f4a62a55bbc7c5334cca5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:29.378617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:29.474924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885b6caf711f4a62a55bbc7c5334cca5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:29.475837 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885b6caf711f4a62a55bbc7c5334cca5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:29.491450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885b6caf711f4a62a55bbc7c5334cca5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:29.522931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885b6caf711f4a62a55bbc7c5334cca5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:29.536855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885b6caf711f4a62a55bbc7c5334cca5'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:29.547805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1170/2332] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:29 2022] DELETE /identity/v3/users/885b6caf711f4a62a55bbc7c5334cca5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:29.549352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:29.549828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:29.549945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:29.574449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:29.575772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:29.657014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1163/2333] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:29.666864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:29.668416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:29.848672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809e4f-af2e-4894-b60a-5d236cdc0af3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:29.852323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:29.852929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:29.853201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:29.853509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:29.862390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:29.863802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:29.873336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1171/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:30.200890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:30.202392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:30.228328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366d6cd-0914-499c-9d22-fd901f444380 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:30.236030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:30.236768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:30.237123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:30.237517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] PATH_INFO: `/v3/projects/ec4ae6b819f24ff79ea93f25097e31e9` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:30.238973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4ae6b819f24ff79ea93f25097e31e9)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:30.241531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:30.311408 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4ae6b819f24ff79ea93f25097e31e9', 'request_id': 'req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.322741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4ae6b819f24ff79ea93f25097e31e9', 'request_id': 'req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.333003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4ae6b819f24ff79ea93f25097e31e9', 'request_id': 'req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.349229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] The token cache is being invalidate because project ec4ae6b819f24ff79ea93f25097e31e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:30.349774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.350589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.352583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1164/2335] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:30 2022] DELETE /identity/v3/projects/ec4ae6b819f24ff79ea93f25097e31e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:30.356717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:30.367673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34580-e5c5-44f4-8136-fba00885e31a service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:30.390382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:30.460980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:30.461737 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:30.462084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:30.462391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] PATH_INFO: `/v3/users/e6152a18c5594d61b303b095f1f4e7c1` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:30.463547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6152a18c5594d61b303b095f1f4e7c1)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:30.465742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:30.516672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6152a18c5594d61b303b095f1f4e7c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.517370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6152a18c5594d61b303b095f1f4e7c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.525172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6152a18c5594d61b303b095f1f4e7c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.537559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6152a18c5594d61b303b095f1f4e7c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.544981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a4db411b-3917-4ed1-b7fc-4a782bd7858f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6152a18c5594d61b303b095f1f4e7c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.551224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1172/2336] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:30 2022] DELETE /identity/v3/users/e6152a18c5594d61b303b095f1f4e7c1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:30.865492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:30.867055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:30.880560 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6cc52-8ed7-489f-bca2-5ff7e39f250e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:30.886032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:30.940382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:30.941010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:30.941380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:30.941655 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] PATH_INFO: `/v3/projects/a41b7e0a49e845e3b406582642ff3913` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:30.942759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41b7e0a49e845e3b406582642ff3913)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:30.944686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:30.991437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41b7e0a49e845e3b406582642ff3913', 'request_id': 'req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:30.997454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41b7e0a49e845e3b406582642ff3913', 'request_id': 'req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:31.006003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41b7e0a49e845e3b406582642ff3913', 'request_id': 'req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:31.016814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] The token cache is being invalidate because project a41b7e0a49e845e3b406582642ff3913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:31.017100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:31.017751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b630c5da-fdd8-41f9-8036-3c72ff42ed5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:31.019316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1165/2337] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:30 2022] DELETE /identity/v3/projects/a41b7e0a49e845e3b406582642ff3913 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:31.025674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.025971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.026229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.045053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:31.046268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:31.108290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1173/2338] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:31.116790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.117072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.117370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.136478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:31.137760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:31.145605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1166/2339] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:31.149870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.160239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5de6d-e6ce-4070-a3a3-ee0f5c205c73 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.164760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.165386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.165668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.165937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.166571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:31.166870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.168495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.180289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1174/2340] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:31.184540 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.193758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9d931-5de6-4039-b012-586acfb0516d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.198955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.199544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.199821 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.200089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.200713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.202613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.229663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1167/2341] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:31.233804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.244259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db948c-1158-4a8a-808d-84342643055e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.269297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:31.302373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.302993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.303270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.303537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.304144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.306132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.326795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1175/2342] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:31.331220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.341610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1af26-33c1-4b38-82cd-795b5e81bf6e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.347011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.347616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.347895 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.348167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.348804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.350440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.361548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1168/2343] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:31.365482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.375404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064dc7-4b6c-4a31-9daf-3448eb31e695 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.380042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e763eb-1a40-4f0a-b002-c073604ca2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.380640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e763eb-1a40-4f0a-b002-c073604ca2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.380906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e763eb-1a40-4f0a-b002-c073604ca2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.381224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e763eb-1a40-4f0a-b002-c073604ca2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.382299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e763eb-1a40-4f0a-b002-c073604ca2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.383992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e763eb-1a40-4f0a-b002-c073604ca2d0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.393818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1176/2344] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:31.397911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.409285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764ee5-91a1-4240-8afa-d69f1eb07bbe admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.414071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.414715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.414994 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.415269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] PATH_INFO: `/v3/projects/aaa394d52ee24393898f1a755d4125bd/users/948d3224717e41719163cafd065b08aa/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.430100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa394d52ee24393898f1a755d4125bd, user_id=948d3224717e41719163cafd065b08aa, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.432716 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.445576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1169/2345] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:31 2022] PUT /identity/v3/projects/aaa394d52ee24393898f1a755d4125bd/users/948d3224717e41719163cafd065b08aa/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:31.456347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.456635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.456909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.486315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] MFA Rules not processed for user `948d3224717e41719163cafd065b08aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:31.487527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:31.549959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1177/2346] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:31.554477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.592447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:31.618371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e56d18-bc42-42fa-abfc-388d731f31dd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.623032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.623631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.623910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.624178 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.624800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.626694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.655886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1170/2347] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:31.660213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.670798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c859-5354-4eb4-9595-b35df77a1b00 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.727048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.727682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.727960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.728234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.728862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.730803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.752121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1178/2348] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:31.756185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.766846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d9a4c-10b1-4051-979a-fa0cbd614b85 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.771444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.772030 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.772307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.772579 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.773206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.774812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.786290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1171/2349] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:31.790370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.800462 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ef93-5e15-4494-bddd-42096accf7bd admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.805106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.805789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.806070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.806350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] PATH_INFO: `/v3/projects/132d56ac1e1e40f0afb0ac01b93b6d58/users/9bc10aba692b43afb4e245eb045172bc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.820546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] RBAC: Authorizing `identity:create_grant(project_id=132d56ac1e1e40f0afb0ac01b93b6d58, user_id=9bc10aba692b43afb4e245eb045172bc, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.823204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.836751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1179/2350] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:31 2022] PUT /identity/v3/projects/132d56ac1e1e40f0afb0ac01b93b6d58/users/9bc10aba692b43afb4e245eb045172bc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:31.840753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.851198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d0bdc-1caa-44d6-96ca-c521978c74ca admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.909221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0e067-05be-47f8-8eb1-92c21828c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.910502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0e067-05be-47f8-8eb1-92c21828c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.910785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0e067-05be-47f8-8eb1-92c21828c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.911052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0e067-05be-47f8-8eb1-92c21828c8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.911720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0e067-05be-47f8-8eb1-92c21828c8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.913319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0e067-05be-47f8-8eb1-92c21828c8e4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.923590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1172/2351] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:31.927877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:31.933666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:31.940397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa94652-5060-494f-8cb3-0239742fddac admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:31.945357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:31.946120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.946498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.946835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] PATH_INFO: `/v3/projects/132d56ac1e1e40f0afb0ac01b93b6d58/users/9bc10aba692b43afb4e245eb045172bc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:31.948800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=132d56ac1e1e40f0afb0ac01b93b6d58, user_id=9bc10aba692b43afb4e245eb045172bc, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:31.951511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:31.962787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1180/2352] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:31 2022] PUT /identity/v3/projects/132d56ac1e1e40f0afb0ac01b93b6d58/users/9bc10aba692b43afb4e245eb045172bc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:31.975955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:31.976419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:31.976708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:32.006750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] MFA Rules not processed for user `9bc10aba692b43afb4e245eb045172bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:32.008447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:32.078620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1173/2353] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:32.091559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:32.094038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:32.152633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e883f2-c2d1-486a-80ea-34bf33a87b1a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:32.156818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5b11e-bb80-46dc-8b85-99957c3a0de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:32.157448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5b11e-bb80-46dc-8b85-99957c3a0de9 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:32.157725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5b11e-bb80-46dc-8b85-99957c3a0de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:32.157992 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5b11e-bb80-46dc-8b85-99957c3a0de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:32.168048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5b11e-bb80-46dc-8b85-99957c3a0de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:32.169486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5b11e-bb80-46dc-8b85-99957c3a0de9 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:32.179433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1181/2354] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:32.252943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:32.262432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1fdfd-044f-44aa-9c16-900a2724fa54 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:32.266582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:32.267173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:32.267451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:32.267723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:32.297531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:32.325619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:32.327056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:32.336404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1174/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:35.712968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:35.713447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:35.713551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:35.731812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:35.732998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:35.787568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1182/2356] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 08:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:35.834626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:35.836041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:35.905432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822c9da-35f4-49dc-9d65-6624c18db9ed service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:35.910898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:35.911497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:35.911776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:35.912046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:35.919986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:35.922236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:35.930110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1175/2357] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:04:39.449101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.527622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28fd4-6fe0-47dc-ac56-68f02859504b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.534781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.535448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.535728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.536001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] PATH_INFO: `/v3/users/948d3224717e41719163cafd065b08aa` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.537313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948d3224717e41719163cafd065b08aa)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.539284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.558892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.562847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.602068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:39.616901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948d3224717e41719163cafd065b08aa'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:39.618008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948d3224717e41719163cafd065b08aa'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:39.631336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948d3224717e41719163cafd065b08aa'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:39.648845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948d3224717e41719163cafd065b08aa'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:39.657769 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b55bbe07-0a3b-45cc-9de2-4bbcfe53afa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948d3224717e41719163cafd065b08aa'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:39.664747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05bb4a-1b6c-43bb-918a-966fcb92e677 service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.665600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1183/2358] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:39 2022] DELETE /identity/v3/users/948d3224717e41719163cafd065b08aa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:39.670290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.670574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.670836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.701799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:39.703216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.739611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:39.748839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.749700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.750079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.750443 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.753286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.766197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.768176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.782766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1176/2359] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:39.809310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1184/2360] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:39.818595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.820473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.905643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53bdf-fbbf-4256-a1ae-89cc529eb020 service placement] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.909535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.910136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.910410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.910677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.921971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.923882 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.934879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1177/2361] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:40.218666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.220197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:40.249305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41e78-ebbb-4bfc-a657-a52780da05a2 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.256000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.256721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.257062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.257433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] PATH_INFO: `/v3/projects/aaa394d52ee24393898f1a755d4125bd` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.258784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa394d52ee24393898f1a755d4125bd)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.260848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.308728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa394d52ee24393898f1a755d4125bd', 'request_id': 'req-50ea123c-588f-44a1-b7f0-d6238465fd0c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.315680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa394d52ee24393898f1a755d4125bd', 'request_id': 'req-50ea123c-588f-44a1-b7f0-d6238465fd0c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.322733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa394d52ee24393898f1a755d4125bd', 'request_id': 'req-50ea123c-588f-44a1-b7f0-d6238465fd0c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.334136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] The token cache is being invalidate because project aaa394d52ee24393898f1a755d4125bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:40.334550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.335196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.336924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1185/2362] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:40 2022] DELETE /identity/v3/projects/aaa394d52ee24393898f1a755d4125bd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:40.340865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.352167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311bd9-0eea-4be4-b4a7-4b2ef21f5230 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.411160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.411704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.411982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.412253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] PATH_INFO: `/v3/users/9bc10aba692b43afb4e245eb045172bc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.413394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc10aba692b43afb4e245eb045172bc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.415283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.462863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc10aba692b43afb4e245eb045172bc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.470699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc10aba692b43afb4e245eb045172bc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.471649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc10aba692b43afb4e245eb045172bc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.485097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc10aba692b43afb4e245eb045172bc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.492117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5d9ee70e-3080-48e0-ae97-44da028dfab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc10aba692b43afb4e245eb045172bc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.499225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1178/2363] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:40 2022] DELETE /identity/v3/users/9bc10aba692b43afb4e245eb045172bc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:40.779492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.782518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:40.802813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea123c-588f-44a1-b7f0-d6238465fd0c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.859946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:40.889117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.889918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.890910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.891185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] PATH_INFO: `/v3/projects/132d56ac1e1e40f0afb0ac01b93b6d58` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.892506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=132d56ac1e1e40f0afb0ac01b93b6d58)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.894526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.958385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132d56ac1e1e40f0afb0ac01b93b6d58', 'request_id': 'req-2e8b78aa-3523-4554-b230-51f4b10eb81b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.965758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132d56ac1e1e40f0afb0ac01b93b6d58', 'request_id': 'req-2e8b78aa-3523-4554-b230-51f4b10eb81b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.974384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132d56ac1e1e40f0afb0ac01b93b6d58', 'request_id': 'req-2e8b78aa-3523-4554-b230-51f4b10eb81b'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.986179 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] The token cache is being invalidate because project 132d56ac1e1e40f0afb0ac01b93b6d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:40.986721 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.987349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2e8b78aa-3523-4554-b230-51f4b10eb81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:40.994214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1186/2364] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:40 2022] DELETE /identity/v3/projects/132d56ac1e1e40f0afb0ac01b93b6d58 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:40.998063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.998512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.998707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.021301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:41.022526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:41.032679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:41.087147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1179/2365] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:41.095514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.095755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.096329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.116936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:41.118182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:41.126052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1187/2366] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:41.130383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.140139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf8eb-5dd7-41f2-9241-f9bc18e00c44 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.144853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.145502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.145784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.146061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.146743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:41.147048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.148678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.164379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1180/2367] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:04:41.166252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.175478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6818-b313-473e-95b4-33604238c28d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.181862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.182474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.182751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.183039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.183647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.185579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.215178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1188/2368] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:41.219547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.229816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37657ca-0f8e-4820-93bd-34389e228435 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.287678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.290776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.290776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.290776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.290776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.295243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.322641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1181/2369] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:41.324107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.338542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f49b38-ed4a-4c9d-aaff-a0b7ada2a985 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.344411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.345313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.345691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.346075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.346829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.348611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.364353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1189/2370] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:41.365767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.377165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131583-cfe3-4833-b1bd-de43a901176c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.383353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb57585-6d40-45a1-8bcc-bf1f5e7a3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.384259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57585-6d40-45a1-8bcc-bf1f5e7a3056 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.384668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57585-6d40-45a1-8bcc-bf1f5e7a3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.385047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57585-6d40-45a1-8bcc-bf1f5e7a3056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.385862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb57585-6d40-45a1-8bcc-bf1f5e7a3056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.387624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb57585-6d40-45a1-8bcc-bf1f5e7a3056 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.405302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1182/2371] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:41.408128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.420712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36d95b-f6df-4259-b296-685889c932b1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.426798 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.427645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.429055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.429493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] PATH_INFO: `/v3/projects/4fdcd504adfd4314a3575fcb4be61bd5/users/e2e5706a861148ebaa14941c6a37f834/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.453097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdcd504adfd4314a3575fcb4be61bd5, user_id=e2e5706a861148ebaa14941c6a37f834, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.455899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.482348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1190/2372] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:41 2022] PUT /identity/v3/projects/4fdcd504adfd4314a3575fcb4be61bd5/users/e2e5706a861148ebaa14941c6a37f834/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:41.484934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.486083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.486472 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.520417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] MFA Rules not processed for user `e2e5706a861148ebaa14941c6a37f834`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:41.522014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:41.604135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1183/2373] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:41.605329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.672681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cfe1-527f-423d-b10c-00408a28d492 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.678042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.678684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.678966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.679241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.679865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.681900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.694464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:41.712802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1191/2374] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:41.716693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.727947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3727409-89bd-4fe0-80bf-751eaab0532c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.733284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:41.800605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.802295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.802767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.803309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.804126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.807458 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.836722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1184/2375] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:41.841730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.862338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa27e41-80ab-4ba8-b311-5ba50d53ebc7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.868377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.869198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.869698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.870143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.870927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.872846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.886036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1192/2376] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:41.890375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.902222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a265e3d-dcc8-4c5f-b15c-4384ed9c713b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.909584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.910252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.910535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.910810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] PATH_INFO: `/v3/projects/c5269047c15d491badfc9d233955b15b/users/ede2ef1c4f524a0485c0950465bd5e52/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.929923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5269047c15d491badfc9d233955b15b, user_id=ede2ef1c4f524a0485c0950465bd5e52, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.932739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.951275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1185/2377] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:41 2022] PUT /identity/v3/projects/c5269047c15d491badfc9d233955b15b/users/ede2ef1c4f524a0485c0950465bd5e52/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:41.952522 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.962739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c5c1-75e8-41a6-b2e1-871b7efdd2b7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:42.033965 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341064ff-d5c0-40a6-9b9e-b871bc4cb10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:42.035081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341064ff-d5c0-40a6-9b9e-b871bc4cb10f admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.035519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341064ff-d5c0-40a6-9b9e-b871bc4cb10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.036438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341064ff-d5c0-40a6-9b9e-b871bc4cb10f admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.037246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341064ff-d5c0-40a6-9b9e-b871bc4cb10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:42.039946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341064ff-d5c0-40a6-9b9e-b871bc4cb10f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:42.059667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1193/2378] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:42.064684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:42.081353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa27d5a-1d07-46ad-8b0b-598a094609ba admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:42.087270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:42.088154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.088656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.090400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] PATH_INFO: `/v3/projects/c5269047c15d491badfc9d233955b15b/users/ede2ef1c4f524a0485c0950465bd5e52/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.094109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5269047c15d491badfc9d233955b15b, user_id=ede2ef1c4f524a0485c0950465bd5e52, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:42.096944 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:42.127143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1186/2379] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:42 2022] PUT /identity/v3/projects/c5269047c15d491badfc9d233955b15b/users/ede2ef1c4f524a0485c0950465bd5e52/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:42.129281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.130596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.131057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.177926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] MFA Rules not processed for user `ede2ef1c4f524a0485c0950465bd5e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:42.179155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:42.258702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1194/2380] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:42.270055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:42.271931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:42.347403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ae5a-466e-4ae5-b4ca-1f2013418814 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:42.351298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:42.351922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.352199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.352831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.363002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:42.365932 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:42.377304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1187/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:42.432205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:42.433638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:42.446328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756419a-8deb-4b95-95e5-2cffcbb8fab7 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:42.450003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:42.450604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.450881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.451152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.530452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:42.532271 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:42.537566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:42.543212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1195/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:43.249422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.251768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.337245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.338250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210648-0528-49bb-835f-80885b45ac5a service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.340078 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.350238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.350875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.351160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.351442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.354867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.363691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:43.368897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.370998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.382739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1188/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:43.410809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d835608-a36f-4d74-a4a4-41ce81241a9c service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.418247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.418888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.419228 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.419444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] PATH_INFO: `/v3/users/9868d0d20b2e4716a4befbbcef40e26c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.420566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9868d0d20b2e4716a4befbbcef40e26c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.422574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.468624 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9868d0d20b2e4716a4befbbcef40e26c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.469183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9868d0d20b2e4716a4befbbcef40e26c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.477172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9868d0d20b2e4716a4befbbcef40e26c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.489718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9868d0d20b2e4716a4befbbcef40e26c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.496614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9868d0d20b2e4716a4befbbcef40e26c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.503308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1196/2384] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:43 2022] DELETE /identity/v3/users/9868d0d20b2e4716a4befbbcef40e26c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:43.674115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.684852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd004bf-c3e7-459d-8fb9-279dc1e7d8e6 service placement] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.743224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.743857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.744135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.744416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] PATH_INFO: `/v3/projects/30fb1a968f1b45439918c2a1e0497d11` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.745564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fb1a968f1b45439918c2a1e0497d11)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.747457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.794299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fb1a968f1b45439918c2a1e0497d11', 'request_id': 'req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.801415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fb1a968f1b45439918c2a1e0497d11', 'request_id': 'req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.810511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fb1a968f1b45439918c2a1e0497d11', 'request_id': 'req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.822105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] The token cache is being invalidate because project 30fb1a968f1b45439918c2a1e0497d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:43.822395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.823021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.824509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1189/2385] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:43 2022] DELETE /identity/v3/projects/30fb1a968f1b45439918c2a1e0497d11 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:43.828731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.830221 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.843759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e6ab-b4f1-4c7a-be67-209557501dfb admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.910335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.910967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.911251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.911526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] PATH_INFO: `/v3/users/3a87f9fb72e24829a9d81c7e00fe660d` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.912640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a87f9fb72e24829a9d81c7e00fe660d)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.914583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.936521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:43.962974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a87f9fb72e24829a9d81c7e00fe660d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.963615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a87f9fb72e24829a9d81c7e00fe660d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.973892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a87f9fb72e24829a9d81c7e00fe660d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.990575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a87f9fb72e24829a9d81c7e00fe660d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.005020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a87f9fb72e24829a9d81c7e00fe660d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.020637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1197/2386] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:43 2022] DELETE /identity/v3/users/3a87f9fb72e24829a9d81c7e00fe660d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:44.197249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:44.199509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:44.221105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5bfa-0e64-493c-ad1d-addd9feb0b51 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:44.296086 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:44.296745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:44.297027 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:44.297327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] PATH_INFO: `/v3/projects/9276db12d05541fb84093612b02d1367` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:44.299177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9276db12d05541fb84093612b02d1367)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:44.301859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:44.341873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:44.363052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9276db12d05541fb84093612b02d1367', 'request_id': 'req-ec64c17a-9566-4153-b4bb-8db843512fe7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.373890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9276db12d05541fb84093612b02d1367', 'request_id': 'req-ec64c17a-9566-4153-b4bb-8db843512fe7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.382742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9276db12d05541fb84093612b02d1367', 'request_id': 'req-ec64c17a-9566-4153-b4bb-8db843512fe7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.394797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] The token cache is being invalidate because project 9276db12d05541fb84093612b02d1367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:44.395083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.396037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ec64c17a-9566-4153-b4bb-8db843512fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:44.397565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1190/2387] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:44 2022] DELETE /identity/v3/projects/9276db12d05541fb84093612b02d1367 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:46.035821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.037227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.050313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a413-d938-450d-84a7-45ce66cedb78 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.105855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.106471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.106746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.107015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] PATH_INFO: `/v3/users/e2e5706a861148ebaa14941c6a37f834` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.108101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e5706a861148ebaa14941c6a37f834)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.110327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.156709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e5706a861148ebaa14941c6a37f834'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.157465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e5706a861148ebaa14941c6a37f834'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.164831 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e5706a861148ebaa14941c6a37f834'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.176645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e5706a861148ebaa14941c6a37f834'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.183294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e5706a861148ebaa14941c6a37f834'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.189575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1198/2388] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:46 2022] DELETE /identity/v3/users/e2e5706a861148ebaa14941c6a37f834 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:46.194021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.194507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.194613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.214452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:46.215663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.273229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1191/2389] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:46.283151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.284475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.304340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:46.342892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f72e-0ccb-4c7d-a610-8dd57fc89236 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.346644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.347247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.347521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.347785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.356920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.358372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.367665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1199/2390] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:46.633754 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.635225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.648663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9394-cd50-4be0-a31e-8f07d6a980d3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.653639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.654814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.655286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.655565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] PATH_INFO: `/v3/projects/4fdcd504adfd4314a3575fcb4be61bd5` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.656706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdcd504adfd4314a3575fcb4be61bd5)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.658628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.705276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdcd504adfd4314a3575fcb4be61bd5', 'request_id': 'req-a94e08da-0207-463e-9fd5-32b117b68f12'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.711452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdcd504adfd4314a3575fcb4be61bd5', 'request_id': 'req-a94e08da-0207-463e-9fd5-32b117b68f12'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.718069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdcd504adfd4314a3575fcb4be61bd5', 'request_id': 'req-a94e08da-0207-463e-9fd5-32b117b68f12'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.728221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] The token cache is being invalidate because project 4fdcd504adfd4314a3575fcb4be61bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:46.728498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.729109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.730600 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1192/2391] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:46 2022] DELETE /identity/v3/projects/4fdcd504adfd4314a3575fcb4be61bd5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:46.735024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.744394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebba0-8a9c-4519-b747-fc67d3791cc2 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.799647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.800277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.800564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.800839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] PATH_INFO: `/v3/users/ede2ef1c4f524a0485c0950465bd5e52` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.801970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede2ef1c4f524a0485c0950465bd5e52)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.803921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.848280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede2ef1c4f524a0485c0950465bd5e52'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.848850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede2ef1c4f524a0485c0950465bd5e52'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.856194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede2ef1c4f524a0485c0950465bd5e52'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.868678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede2ef1c4f524a0485c0950465bd5e52'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.876213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-5a6b8499-8aeb-4b18-b2b0-bf3caf5500bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede2ef1c4f524a0485c0950465bd5e52'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.882195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1200/2392] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:46 2022] DELETE /identity/v3/users/ede2ef1c4f524a0485c0950465bd5e52 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.154718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.156687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.170068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e08da-0207-463e-9fd5-32b117b68f12 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.205596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.231567 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.232199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.232477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.232748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] PATH_INFO: `/v3/projects/c5269047c15d491badfc9d233955b15b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.234371 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5269047c15d491badfc9d233955b15b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.236290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.281280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5269047c15d491badfc9d233955b15b', 'request_id': 'req-0926160f-1833-47ae-8220-0b3535fef97f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.287225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5269047c15d491badfc9d233955b15b', 'request_id': 'req-0926160f-1833-47ae-8220-0b3535fef97f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.294608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5269047c15d491badfc9d233955b15b', 'request_id': 'req-0926160f-1833-47ae-8220-0b3535fef97f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.305537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] The token cache is being invalidate because project c5269047c15d491badfc9d233955b15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:47.305829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.306461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0926160f-1833-47ae-8220-0b3535fef97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.307926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1193/2393] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:47 2022] DELETE /identity/v3/projects/c5269047c15d491badfc9d233955b15b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.313414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.313880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.313982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.333283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.334501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.368214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.395246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1201/2394] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.403324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.403612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.403890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.424336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.425573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.433360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1194/2395] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.437967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.447420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1030-2897-4841-b964-4bab41fa0e45 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.451906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.452504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.452766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.453033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.453695 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:47.453993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.455566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.466868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1202/2396] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:04:47.471008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.480321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced80e97-2f0e-44f2-96ce-f3ccdb73b56d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.485464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.486054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.486338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.486612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.487270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.489147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.516272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1195/2397] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:47.520292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.530284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be13b3-e32c-4522-be07-4bcaebcea358 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.588082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.588686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.588967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.589235 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.589897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.591803 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.612913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1203/2398] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:47.617102 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.628033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f59e7-622b-49ea-8229-facdd2bb25cc admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.632647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.633239 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.633553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.633829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.634466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.636113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.646029 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1196/2399] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:47.649905 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.660489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f780a-ee28-4479-8ae3-b4c6886fe085 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.665121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571855d-1dca-47b1-8791-54e5e3ff428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.665749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571855d-1dca-47b1-8791-54e5e3ff428c admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.666046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571855d-1dca-47b1-8791-54e5e3ff428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.666309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571855d-1dca-47b1-8791-54e5e3ff428c admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.666942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571855d-1dca-47b1-8791-54e5e3ff428c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.668523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571855d-1dca-47b1-8791-54e5e3ff428c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.678922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1204/2400] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:47.682931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.693282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911a821-2274-479e-8815-53dd5112608c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.697802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.698436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.698715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.698987 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] PATH_INFO: `/v3/projects/a6672ff8006045358b9024dc20b8e7c2/users/7f313e1a1e724323b73f34140094e220/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.713948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6672ff8006045358b9024dc20b8e7c2, user_id=7f313e1a1e724323b73f34140094e220, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.716639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.729916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1197/2401] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:47 2022] PUT /identity/v3/projects/a6672ff8006045358b9024dc20b8e7c2/users/7f313e1a1e724323b73f34140094e220/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.741005 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.741320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.741598 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.768800 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] MFA Rules not processed for user `7f313e1a1e724323b73f34140094e220`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.770046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.831794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1205/2402] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.836259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.898148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfb27-77f3-4ba7-8391-5b7ecae0e1cd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.902971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.903569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.903849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.904125 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.904747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.907174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.916414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.935814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1198/2403] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:47.940384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.951035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950a03-9a9e-4440-aa09-e41107ed91fc None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.984385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.009595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.010197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.010472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.010738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.011354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.013291 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.035517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1206/2404] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:48.039411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.050235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da712-f5f1-4862-8c76-525cb6e61bc7 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.054984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.055581 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.055860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.056131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.056762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.058411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.068827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1199/2405] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.072850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.082628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1a1b-efa8-4654-9c48-4593f20ae6d8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.087198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.087836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.088112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.088384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] PATH_INFO: `/v3/projects/37520c00a0ae42bf9f8c86f508c4b48c/users/8772445f7be040c595d8276ba2f1bd14/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.102521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37520c00a0ae42bf9f8c86f508c4b48c, user_id=8772445f7be040c595d8276ba2f1bd14, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.105131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.118576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1207/2406] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:48 2022] PUT /identity/v3/projects/37520c00a0ae42bf9f8c86f508c4b48c/users/8772445f7be040c595d8276ba2f1bd14/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:48.122485 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.132363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42b56-5060-4278-8667-03b7f39e2546 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.188303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d25d0-8aad-46a6-8bf4-9d996695bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.188912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d25d0-8aad-46a6-8bf4-9d996695bb1e admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.189195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d25d0-8aad-46a6-8bf4-9d996695bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.189502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d25d0-8aad-46a6-8bf4-9d996695bb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.190137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d25d0-8aad-46a6-8bf4-9d996695bb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.191730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d25d0-8aad-46a6-8bf4-9d996695bb1e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.201517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1200/2407] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.206365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.216767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236c38-311b-449c-a182-e029ad3ab39e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.221951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.222600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.222879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.223147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] PATH_INFO: `/v3/projects/37520c00a0ae42bf9f8c86f508c4b48c/users/8772445f7be040c595d8276ba2f1bd14/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.225069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=37520c00a0ae42bf9f8c86f508c4b48c, user_id=8772445f7be040c595d8276ba2f1bd14, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.227697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.237701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1208/2408] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:48 2022] PUT /identity/v3/projects/37520c00a0ae42bf9f8c86f508c4b48c/users/8772445f7be040c595d8276ba2f1bd14/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:48.247709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.248186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.248301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.276433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] MFA Rules not processed for user `8772445f7be040c595d8276ba2f1bd14`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.277916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.350047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1201/2409] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.361411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.363156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.420079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94190587-ea41-4ec6-90a8-5d7db1f950ba admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.423682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bedef8-f20a-429e-8779-75816a9b3a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.424272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedef8-f20a-429e-8779-75816a9b3a17 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.424547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedef8-f20a-429e-8779-75816a9b3a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.424813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedef8-f20a-429e-8779-75816a9b3a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.433870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bedef8-f20a-429e-8779-75816a9b3a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.435299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bedef8-f20a-429e-8779-75816a9b3a17 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.445419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1209/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:48.824908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.886286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83c0f2-d8e5-49b7-8bde-260936c12e31 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.891350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.891977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.892261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.892536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] PATH_INFO: `/v3/users/7f313e1a1e724323b73f34140094e220` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.893678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f313e1a1e724323b73f34140094e220)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.895630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.897113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.941820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f313e1a1e724323b73f34140094e220'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.948879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f313e1a1e724323b73f34140094e220'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.949521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f313e1a1e724323b73f34140094e220'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.961948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f313e1a1e724323b73f34140094e220'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.969103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f313e1a1e724323b73f34140094e220'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.974912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1202/2411] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:48 2022] DELETE /identity/v3/users/7f313e1a1e724323b73f34140094e220 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:48.979569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.979857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.980136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.998596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.999789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.057629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1210/2412] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:49.067520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.069045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.127711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b60a-a7c9-4dfc-8436-458d7a1d0a46 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.131346 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.131940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.132217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.132484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.142079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.143491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.152963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1203/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:49.419002 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.420436 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.433125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454546f-e71b-473d-bdaf-53813ecaa082 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.438395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.439027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.439301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.439571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] PATH_INFO: `/v3/projects/a6672ff8006045358b9024dc20b8e7c2` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.440685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6672ff8006045358b9024dc20b8e7c2)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.442670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.473597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:49.491822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6672ff8006045358b9024dc20b8e7c2', 'request_id': 'req-f49064c9-60c3-47ea-831b-7d48057d1648'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.500305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6672ff8006045358b9024dc20b8e7c2', 'request_id': 'req-f49064c9-60c3-47ea-831b-7d48057d1648'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.507885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6672ff8006045358b9024dc20b8e7c2', 'request_id': 'req-f49064c9-60c3-47ea-831b-7d48057d1648'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.518309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] The token cache is being invalidate because project a6672ff8006045358b9024dc20b8e7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:49.518603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.519219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.520686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1211/2414] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:49 2022] DELETE /identity/v3/projects/a6672ff8006045358b9024dc20b8e7c2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:49.524575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.534391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30d0d-bf01-4ffa-977e-aaf157049030 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.589481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.590100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.590382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.590654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] PATH_INFO: `/v3/users/8772445f7be040c595d8276ba2f1bd14` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.591757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8772445f7be040c595d8276ba2f1bd14)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.593758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.615797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:49.639934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8772445f7be040c595d8276ba2f1bd14'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.647014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8772445f7be040c595d8276ba2f1bd14'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.647633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8772445f7be040c595d8276ba2f1bd14'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.659599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8772445f7be040c595d8276ba2f1bd14'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.666332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4a579f9f-f83c-4fc2-84eb-b34cbf1b6fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8772445f7be040c595d8276ba2f1bd14'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.672588 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1204/2415] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:49 2022] DELETE /identity/v3/users/8772445f7be040c595d8276ba2f1bd14 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:49.942111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.943597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.957101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49064c9-60c3-47ea-831b-7d48057d1648 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.013681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.014263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.014537 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.015558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] PATH_INFO: `/v3/projects/37520c00a0ae42bf9f8c86f508c4b48c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.016682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=37520c00a0ae42bf9f8c86f508c4b48c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.018654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.069266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37520c00a0ae42bf9f8c86f508c4b48c', 'request_id': 'req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:50.075423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37520c00a0ae42bf9f8c86f508c4b48c', 'request_id': 'req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:50.083361 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37520c00a0ae42bf9f8c86f508c4b48c', 'request_id': 'req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:50.093824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] The token cache is being invalidate because project 37520c00a0ae42bf9f8c86f508c4b48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:50.094121 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:50.094759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2d9c0ee2-b0b7-4f3e-b1df-9aedaa725fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:50.096262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1212/2416] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:49 2022] DELETE /identity/v3/projects/37520c00a0ae42bf9f8c86f508c4b48c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:50.101151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.101477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.101751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.121367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:50.122617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:50.180696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1205/2417] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:50.189041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.189357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.189635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.208959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:50.210175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:50.217923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1213/2418] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:50.227066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.237429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf125e67-7c27-43a8-bd5f-4b0fd99cb3e2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.242041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.242639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.242920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.243196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.243840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:50.244174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.245802 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.257597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1206/2419] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:50.261910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.271074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40427a2c-1dd2-4c45-b259-0eb98ff4eaef None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.275754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.276345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.276619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.277145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.277797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.279700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.306595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1214/2420] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:50 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:50.310880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.321351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e9119-d884-45b3-9de1-37a6798a232d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.377616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.378216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.378491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.378758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.379381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.381316 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.402622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1207/2421] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:50 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:50.406855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.417158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d04919-988c-4f1d-9f2e-53e4b162a9b9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.422324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.422924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.423190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.423463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.424094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.425741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.435518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1215/2422] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:50.440068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.450024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15b63d-c469-458e-b118-500d9880caf1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.454654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfeada-9c1d-4518-be7e-e3b217e4f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.455237 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfeada-9c1d-4518-be7e-e3b217e4f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.455516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfeada-9c1d-4518-be7e-e3b217e4f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.455788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfeada-9c1d-4518-be7e-e3b217e4f0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.456416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfeada-9c1d-4518-be7e-e3b217e4f0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.458059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfeada-9c1d-4518-be7e-e3b217e4f0b9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.468751 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1208/2423] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:50.472617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.479031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:50.483000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea01d2c-a95b-4092-9447-051fd82fccbe admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.489523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.490357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.490833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.491169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] PATH_INFO: `/v3/projects/6fa574239ca2486294fcca9144f3aef5/users/e8a4e5a187cd4582b4cd7347dbbf3240/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.506015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa574239ca2486294fcca9144f3aef5, user_id=e8a4e5a187cd4582b4cd7347dbbf3240, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.508637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.521184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1216/2424] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:50 2022] PUT /identity/v3/projects/6fa574239ca2486294fcca9144f3aef5/users/e8a4e5a187cd4582b4cd7347dbbf3240/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:50.585099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.585835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.585835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.599286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:50.615024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] MFA Rules not processed for user `e8a4e5a187cd4582b4cd7347dbbf3240`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:50.616249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:50.679075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1209/2425] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:50.689728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.691427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:50.747773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9178d-83b7-42d8-b891-ade8a0065011 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.751413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2dff-40bf-4ac4-bd5d-0e85bdd39f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.752009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2dff-40bf-4ac4-bd5d-0e85bdd39f32 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.752285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2dff-40bf-4ac4-bd5d-0e85bdd39f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.752558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2dff-40bf-4ac4-bd5d-0e85bdd39f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.760635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2dff-40bf-4ac4-bd5d-0e85bdd39f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.762071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2dff-40bf-4ac4-bd5d-0e85bdd39f32 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.770704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1217/2426] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:56.050117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:56.111024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a026a-90d8-463a-8679-7bac0c48770c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:56.115595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:56.116187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.116463 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.116731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] PATH_INFO: `/v3/users/e8a4e5a187cd4582b4cd7347dbbf3240` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.117843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a4e5a187cd4582b4cd7347dbbf3240)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:56.119739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:56.163983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a4e5a187cd4582b4cd7347dbbf3240'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.171808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a4e5a187cd4582b4cd7347dbbf3240'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.172419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a4e5a187cd4582b4cd7347dbbf3240'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.184218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a4e5a187cd4582b4cd7347dbbf3240'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.190967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a4e5a187cd4582b4cd7347dbbf3240'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.196748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1210/2427] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:56 2022] DELETE /identity/v3/users/e8a4e5a187cd4582b4cd7347dbbf3240 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:56.201458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.202432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.202550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.220838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:56.222043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:56.279137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1218/2428] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:56.289072 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:56.290631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:56.309446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:56.349161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f81513-8b19-4c43-84d2-e3bb775ec47f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:56.352896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e4b5a-2b4f-4cab-8521-8f7d48c99ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:56.353521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e4b5a-2b4f-4cab-8521-8f7d48c99ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.353804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e4b5a-2b4f-4cab-8521-8f7d48c99ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.354076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e4b5a-2b4f-4cab-8521-8f7d48c99ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.363744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e4b5a-2b4f-4cab-8521-8f7d48c99ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:56.365199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e4b5a-2b4f-4cab-8521-8f7d48c99ba1 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:56.375087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1211/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:56.634627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:56.636070 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:56.648625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df157-f8da-4f64-92c3-dfa461529303 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:56.653802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:56.654368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.654651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.654922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] PATH_INFO: `/v3/projects/6fa574239ca2486294fcca9144f3aef5` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.656165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa574239ca2486294fcca9144f3aef5)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:56.658131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:56.706324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa574239ca2486294fcca9144f3aef5', 'request_id': 'req-c7c84be4-bcd6-446d-9364-90db7ae674c7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.712341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa574239ca2486294fcca9144f3aef5', 'request_id': 'req-c7c84be4-bcd6-446d-9364-90db7ae674c7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.719409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa574239ca2486294fcca9144f3aef5', 'request_id': 'req-c7c84be4-bcd6-446d-9364-90db7ae674c7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.729795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] The token cache is being invalidate because project 6fa574239ca2486294fcca9144f3aef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:56.730082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.730710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c7c84be4-bcd6-446d-9364-90db7ae674c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:56.732231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1219/2430] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:56 2022] DELETE /identity/v3/projects/6fa574239ca2486294fcca9144f3aef5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:56.737118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.737442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.737725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.758245 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:56.759455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:56.818324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1212/2431] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:56.826110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.826392 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.826662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.841232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:56.846556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:56.848383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:56.856587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1220/2432] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:56.860596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:56.870156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0fc87-ca5d-42f6-99b7-64a7b183832a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:56.875261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:56.875862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.876142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.876518 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.877045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:56.877381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:56.878967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:56.891048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1213/2433] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:56.895262 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:56.904412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6603e-e7df-45c0-bd98-f260820d8112 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:56.909063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:56.909681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:56.909953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:56.910220 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:56.910835 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:56.912699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:56.939346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1221/2434] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:56 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:56.943584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:56.954213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2ebbd-b3b9-4283-952b-d6fb80a97045 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.009676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.010272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.010554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.010830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.011442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.013420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.032875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1214/2435] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:56 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:57.037143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.047830 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f362f-7f8c-4ebe-b5f4-be62d5b5b161 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.052488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.053086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.053402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.053679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.054313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.055889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.066209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1222/2436] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:57.070026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.079901 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073a6e8-70a9-4f0f-b9e4-e73a1631bdb8 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.084551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc1be3-be30-40d6-92e1-1d6e5f6f1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.085166 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1be3-be30-40d6-92e1-1d6e5f6f1557 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.085471 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1be3-be30-40d6-92e1-1d6e5f6f1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.085749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1be3-be30-40d6-92e1-1d6e5f6f1557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.086386 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc1be3-be30-40d6-92e1-1d6e5f6f1557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.087963 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc1be3-be30-40d6-92e1-1d6e5f6f1557 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.098384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1215/2437] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:57.102223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.112470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816de0-d2fe-472f-b080-b7117f8fdfbf admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.117314 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.117954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.118233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.118506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] PATH_INFO: `/v3/projects/a2e00e9538104af886e68386d5f05171/users/cc70c20357d44e0a8e72edad2de453c3/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.133582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e00e9538104af886e68386d5f05171, user_id=cc70c20357d44e0a8e72edad2de453c3, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.136243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.148746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1223/2438] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:57 2022] PUT /identity/v3/projects/a2e00e9538104af886e68386d5f05171/users/cc70c20357d44e0a8e72edad2de453c3/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:57.160165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.160455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.160730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.188572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] MFA Rules not processed for user `cc70c20357d44e0a8e72edad2de453c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:57.189804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:57.201156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:57.254123 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1216/2439] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:57.258600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.319859 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34995a-bf8b-4a89-8135-0e29cc6800c8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.324490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.325086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.325394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.325662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.326292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.328231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.355857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1224/2440] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:57 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:57.360432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.371305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f227ad1-aa7b-4838-9a2f-9dfc11d294f3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.427654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.428256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.428539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.428814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.429474 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.431395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.451822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1217/2441] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:57 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:57.455993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.466306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddb5a8-0518-4981-af14-774b0dacf2af admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.471302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.471889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.472161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.472430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.473053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.474655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.485514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1225/2442] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:57.489570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.499317 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d693f-dce4-4d9b-9437-bd8d1ed2876a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.503904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.504570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.504850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.505120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] PATH_INFO: `/v3/projects/e6ca51a9bedd4734bd18e1e1004f5cb1/users/cf2d957041c448dfa17c27777a0915fe/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.519438 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca51a9bedd4734bd18e1e1004f5cb1, user_id=cf2d957041c448dfa17c27777a0915fe, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.522118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.535817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1218/2443] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:57 2022] PUT /identity/v3/projects/e6ca51a9bedd4734bd18e1e1004f5cb1/users/cf2d957041c448dfa17c27777a0915fe/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:57.539809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.550229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3a701-aa27-4126-b6b6-738cf0f4ceca admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.606226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f7cac-c606-4a6f-af40-c322e14abf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.606826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7cac-c606-4a6f-af40-c322e14abf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.607101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7cac-c606-4a6f-af40-c322e14abf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.607368 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7cac-c606-4a6f-af40-c322e14abf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.607986 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7cac-c606-4a6f-af40-c322e14abf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.610142 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7cac-c606-4a6f-af40-c322e14abf54 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.619541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1226/2444] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:57.624325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.634823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e9618-55eb-40d1-b365-5ed1d35fa285 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.639462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.640116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.640394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.640667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] PATH_INFO: `/v3/projects/e6ca51a9bedd4734bd18e1e1004f5cb1/users/cf2d957041c448dfa17c27777a0915fe/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.642620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ca51a9bedd4734bd18e1e1004f5cb1, user_id=cf2d957041c448dfa17c27777a0915fe, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.645206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.655991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1219/2445] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:57 2022] PUT /identity/v3/projects/e6ca51a9bedd4734bd18e1e1004f5cb1/users/cf2d957041c448dfa17c27777a0915fe/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:57.666119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.666398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.666666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.691329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:57.694299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] MFA Rules not processed for user `cf2d957041c448dfa17c27777a0915fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:57.695995 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:57.761916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1227/2446] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:04:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:57.773209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:57.775035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:57.831868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc077-ae53-4e4f-98f3-1f23e57f9009 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:57.835394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d37b5-7cfa-4ffb-b0bc-19aab9ca4c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:57.835980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d37b5-7cfa-4ffb-b0bc-19aab9ca4c15 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.836257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d37b5-7cfa-4ffb-b0bc-19aab9ca4c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.836527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d37b5-7cfa-4ffb-b0bc-19aab9ca4c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.855017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:57.893592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d37b5-7cfa-4ffb-b0bc-19aab9ca4c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:57.895035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d37b5-7cfa-4ffb-b0bc-19aab9ca4c15 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:57.904095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1220/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:00.424090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:00.486226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9765-9398-4b62-9a0c-5a4f17790d7f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:00.490691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:00.491308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:00.491582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:00.491853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] PATH_INFO: `/v3/users/cc70c20357d44e0a8e72edad2de453c3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:00.492954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc70c20357d44e0a8e72edad2de453c3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:00.494883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:00.540732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc70c20357d44e0a8e72edad2de453c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.541402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc70c20357d44e0a8e72edad2de453c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.548491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc70c20357d44e0a8e72edad2de453c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.560534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc70c20357d44e0a8e72edad2de453c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.567765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc70c20357d44e0a8e72edad2de453c3'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.573716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1228/2448] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:00 2022] DELETE /identity/v3/users/cc70c20357d44e0a8e72edad2de453c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:00.578715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:00.579163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:00.579260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:00.597667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:00.598773 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:00.657450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1221/2449] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:00.667154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:00.668534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:00.688842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:00.733014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b28d31-c15d-4dda-849a-3f5862600859 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:00.736696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:00.737328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:00.737608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:00.737877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:00.746706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:00.748122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:00.757371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1229/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:01.028049 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.029537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:01.049881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5f97f-1a84-4c91-8b35-20b276b9ddd2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.055912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.056617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.056905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.057206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] PATH_INFO: `/v3/projects/a2e00e9538104af886e68386d5f05171` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.058382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e00e9538104af886e68386d5f05171)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.060267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.106255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e00e9538104af886e68386d5f05171', 'request_id': 'req-41506c77-88a5-45bb-9b99-628e7ad864ca'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.112866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e00e9538104af886e68386d5f05171', 'request_id': 'req-41506c77-88a5-45bb-9b99-628e7ad864ca'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.119663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e00e9538104af886e68386d5f05171', 'request_id': 'req-41506c77-88a5-45bb-9b99-628e7ad864ca'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.129747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] The token cache is being invalidate because project a2e00e9538104af886e68386d5f05171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:01.130036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.130675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.132139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1222/2451] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:01 2022] DELETE /identity/v3/projects/a2e00e9538104af886e68386d5f05171 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:01.136285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.145723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c8fb-581f-4b62-b3b6-f9c2943e23a5 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.200766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.201415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.201692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.202493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] PATH_INFO: `/v3/users/cf2d957041c448dfa17c27777a0915fe` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.203625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2d957041c448dfa17c27777a0915fe)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.205543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.249643 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2d957041c448dfa17c27777a0915fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.250297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2d957041c448dfa17c27777a0915fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.257170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2d957041c448dfa17c27777a0915fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.270472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2d957041c448dfa17c27777a0915fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.277524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-479582cd-03e9-4471-9a00-fd9bdc50f0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2d957041c448dfa17c27777a0915fe'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.283305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1230/2452] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:01 2022] DELETE /identity/v3/users/cf2d957041c448dfa17c27777a0915fe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:01.550843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.552270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:01.568079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41506c77-88a5-45bb-9b99-628e7ad864ca admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.610202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:01.627202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.628270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.628557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.628862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] PATH_INFO: `/v3/projects/e6ca51a9bedd4734bd18e1e1004f5cb1` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.630002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ca51a9bedd4734bd18e1e1004f5cb1)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.631890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.677432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ca51a9bedd4734bd18e1e1004f5cb1', 'request_id': 'req-e3fd151e-9207-4d37-92f6-bae4635cf719'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.683415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ca51a9bedd4734bd18e1e1004f5cb1', 'request_id': 'req-e3fd151e-9207-4d37-92f6-bae4635cf719'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.690715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ca51a9bedd4734bd18e1e1004f5cb1', 'request_id': 'req-e3fd151e-9207-4d37-92f6-bae4635cf719'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.700839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] The token cache is being invalidate because project e6ca51a9bedd4734bd18e1e1004f5cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:01.701128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.702277 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-e3fd151e-9207-4d37-92f6-bae4635cf719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.703743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1223/2453] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:01 2022] DELETE /identity/v3/projects/e6ca51a9bedd4734bd18e1e1004f5cb1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:01.708716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.709211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.709347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.728891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:01.730131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:01.762289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:01.789673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1231/2454] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:01.798156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.798446 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.798723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.818449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:01.819646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:01.827394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1224/2455] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:01.831574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.841170 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514d64-2f06-4676-9f53-2aae76f6963d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.846302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.846889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.847164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.847435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.848071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:01.848365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.850015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.861875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1232/2456] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:01.866139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.875611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993acc5c-3560-4980-a89c-226f4c1e21e4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.880913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.881550 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.881827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.882196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.882883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.884931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.912995 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1225/2457] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:01 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:01.917115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.927493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c383-75c1-48fc-9d9a-ccb373410cd6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.982214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.982811 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.983632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.983913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.984546 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.986499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:02.006734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1233/2458] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:01 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:02.010798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:02.021048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcb1f5-65fc-4e53-bb48-2330cacf1f1d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:02.025794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:02.026547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.027079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.027351 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.027973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:02.029565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:02.039953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1226/2459] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:02.043539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:02.053972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8596204-fc96-4fcd-9df2-271894f0e5a1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:02.058559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684823ea-5912-415b-83bb-f88778668ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:02.059151 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684823ea-5912-415b-83bb-f88778668ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.059431 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684823ea-5912-415b-83bb-f88778668ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.059706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684823ea-5912-415b-83bb-f88778668ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.060338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684823ea-5912-415b-83bb-f88778668ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:02.061984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684823ea-5912-415b-83bb-f88778668ce5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:02.072203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1234/2460] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:02.076229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:02.086062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0104177-f3e6-4eaa-bb5c-095cc314234a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:02.090539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:02.091168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.091444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.091717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] PATH_INFO: `/v3/projects/342c029caf2b46ff98cc1d229c498837/users/19b9a5d74cf04e829c34fe22e20bb560/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.106379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=342c029caf2b46ff98cc1d229c498837, user_id=19b9a5d74cf04e829c34fe22e20bb560, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:02.109555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:02.122325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1227/2461] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:02 2022] PUT /identity/v3/projects/342c029caf2b46ff98cc1d229c498837/users/19b9a5d74cf04e829c34fe22e20bb560/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:02.127450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e426e30-ad4d-4497-93c9-48d80501912e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.127763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e426e30-ad4d-4497-93c9-48d80501912e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.128079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e426e30-ad4d-4497-93c9-48d80501912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.146281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8e426e30-ad4d-4497-93c9-48d80501912e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:02.147417 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8e426e30-ad4d-4497-93c9-48d80501912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:02.205572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1235/2462] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:02.215020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:02.216757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:02.271708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87a2b5-7b32-44a5-970a-95fe1cab7bad admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:02.275260 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:02.275852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.276131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.276399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.286063 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:02.287565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:02.297143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1228/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:02.902150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9998ce8-168c-429d-a951-a39df9adab88 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.902649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9998ce8-168c-429d-a951-a39df9adab88 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.902747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9998ce8-168c-429d-a951-a39df9adab88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.930778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a9998ce8-168c-429d-a951-a39df9adab88 None None] MFA Rules not processed for user `19b9a5d74cf04e829c34fe22e20bb560`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:02.931833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a9998ce8-168c-429d-a951-a39df9adab88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:02.967679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:03.002343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1236/2464] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:03.013418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.014812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:03.029871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:03.079659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d103b-7bb2-49cd-a2a2-3b2b48b326aa service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.083193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b74a8-50cb-4433-a195-31eefbe076fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.083790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b74a8-50cb-4433-a195-31eefbe076fa service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.084065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b74a8-50cb-4433-a195-31eefbe076fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.084331 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b74a8-50cb-4433-a195-31eefbe076fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.093135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b74a8-50cb-4433-a195-31eefbe076fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.094576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b74a8-50cb-4433-a195-31eefbe076fa service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.103573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1229/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:04.449498 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88ec3-17f4-46cd-9c59-854a7fd84bfb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:04.450035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88ec3-17f4-46cd-9c59-854a7fd84bfb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:04.450035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88ec3-17f4-46cd-9c59-854a7fd84bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:04.469799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-44a88ec3-17f4-46cd-9c59-854a7fd84bfb None None] MFA Rules not processed for user `19b9a5d74cf04e829c34fe22e20bb560`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:04.470984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-44a88ec3-17f4-46cd-9c59-854a7fd84bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:04.477836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1237/2466] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:13.099517 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=20 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:14.464968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=14 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:23.846831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549b30c-582c-48c1-b048-17d6eeef0d34 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:23.847428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549b30c-582c-48c1-b048-17d6eeef0d34 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:23.847428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549b30c-582c-48c1-b048-17d6eeef0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:23.867613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9549b30c-582c-48c1-b048-17d6eeef0d34 None None] MFA Rules not processed for user `19b9a5d74cf04e829c34fe22e20bb560`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:23.868860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9549b30c-582c-48c1-b048-17d6eeef0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:23.877173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1230/2467] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:24.970130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:24.970682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:24.970682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:24.989065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] MFA Rules not processed for user `39d380ad69d9417a86f88f45341b68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:24.990328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:25.046802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1238/2468] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:05:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:32.076236 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33b642-4453-4980-afc9-a641e57b4dd4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:32.076736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33b642-4453-4980-afc9-a641e57b4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:32.076926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33b642-4453-4980-afc9-a641e57b4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:32.101390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-be33b642-4453-4980-afc9-a641e57b4dd4 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:32.102634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-be33b642-4453-4980-afc9-a641e57b4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:32.166654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1231/2469] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:32.184583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:32.186294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:32.270933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9831-2d9c-422c-9f3c-60d83fcb5107 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:32.275864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:32.276479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:32.277009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:32.277313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:32.286242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:32.287821 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:32.295793 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1239/2470] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:42.159090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=28 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:42.292488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=57 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:45.918283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f99b46-b04c-4444-9cfe-e39f16049f4d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:45.918767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f99b46-b04c-4444-9cfe-e39f16049f4d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:45.918874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f99b46-b04c-4444-9cfe-e39f16049f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:45.960127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-55f99b46-b04c-4444-9cfe-e39f16049f4d None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:45.961688 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-55f99b46-b04c-4444-9cfe-e39f16049f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:46.004749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1232/2471] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:46.018164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:46.063519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e951d6-5746-45cf-b3fb-fd34a41c36a1 service swift] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:46.068857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364f8d-65fc-40b8-acc9-89f2c29d193b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:46.069597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364f8d-65fc-40b8-acc9-89f2c29d193b service swift] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:46.069942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364f8d-65fc-40b8-acc9-89f2c29d193b service swift] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:46.070418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364f8d-65fc-40b8-acc9-89f2c29d193b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:46.079915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e364f8d-65fc-40b8-acc9-89f2c29d193b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:46.081657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e364f8d-65fc-40b8-acc9-89f2c29d193b service swift] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:46.091706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1240/2472] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:51.350242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d8f3-5a03-444d-97d0-d81c09febd77 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.351162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d8f3-5a03-444d-97d0-d81c09febd77 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.351621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d8f3-5a03-444d-97d0-d81c09febd77 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:51.352989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1233/2473] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 08:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:05:51.359227 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e862e-a523-44ff-9192-66f99a76e54a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.359764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e862e-a523-44ff-9192-66f99a76e54a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.359978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e862e-a523-44ff-9192-66f99a76e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:51.415662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-289e862e-a523-44ff-9192-66f99a76e54a None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:51.416990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-289e862e-a523-44ff-9192-66f99a76e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:51.545482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260d8f3-5a03-444d-97d0-d81c09febd77 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:51.545482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3260d8f3-5a03-444d-97d0-d81c09febd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:51.545854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1241/2474] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 08:05:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:51.625179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260d8f3-5a03-444d-97d0-d81c09febd77 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:51.628971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b40ebb-a049-429a-a8c2-8c908c1ea009 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:51.629927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40ebb-a049-429a-a8c2-8c908c1ea009 service glance] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.630431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40ebb-a049-429a-a8c2-8c908c1ea009 service glance] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.630766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40ebb-a049-429a-a8c2-8c908c1ea009 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:51.644290 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b40ebb-a049-429a-a8c2-8c908c1ea009 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:51.645855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b40ebb-a049-429a-a8c2-8c908c1ea009 service glance] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:51.663146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1234/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:51.750790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e850d-2e31-4075-ba81-a101b997060c None None] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.751019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e850d-2e31-4075-ba81-a101b997060c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.751629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e850d-2e31-4075-ba81-a101b997060c None None] PATH_INFO: `/` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:51.757310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1242/2476] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 08:05:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:05:51.762920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b351eb-4d2e-462a-95aa-f7c42a4274ea None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.763591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b351eb-4d2e-462a-95aa-f7c42a4274ea None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.764207 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b351eb-4d2e-462a-95aa-f7c42a4274ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:51.791230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-00b351eb-4d2e-462a-95aa-f7c42a4274ea None None] MFA Rules not processed for user `7e67c56fb2c8419aa5ed846d5412e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:51.792601 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-00b351eb-4d2e-462a-95aa-f7c42a4274ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:51.800271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1235/2477] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 08:05:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:51.817203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e850d-2e31-4075-ba81-a101b997060c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:51.819243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5e0e850d-2e31-4075-ba81-a101b997060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:51.839344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e850d-2e31-4075-ba81-a101b997060c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:51.844627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc22ae2-9d81-43e9-b831-5db7c222ee23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:51.845499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc22ae2-9d81-43e9-b831-5db7c222ee23 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.845782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc22ae2-9d81-43e9-b831-5db7c222ee23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.846226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc22ae2-9d81-43e9-b831-5db7c222ee23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:51.857020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc22ae2-9d81-43e9-b831-5db7c222ee23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:51.858443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc22ae2-9d81-43e9-b831-5db7c222ee23 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:51.871038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1243/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:51.998852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eabef-31ba-424c-9290-a3594cf42842 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:51.999425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eabef-31ba-424c-9290-a3594cf42842 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:51.999817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eabef-31ba-424c-9290-a3594cf42842 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:52.001634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1236/2479] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 08:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:05:52.008867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287d32f-4d89-4a0f-9b14-929b24eef96f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:52.009148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287d32f-4d89-4a0f-9b14-929b24eef96f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:52.009466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287d32f-4d89-4a0f-9b14-929b24eef96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:52.035723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b287d32f-4d89-4a0f-9b14-929b24eef96f None None] MFA Rules not processed for user `8324e7cb70744038987b7d15f002160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:52.036980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b287d32f-4d89-4a0f-9b14-929b24eef96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:52.052646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1244/2480] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 08:05:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:52.063671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eabef-31ba-424c-9290-a3594cf42842 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:52.075557 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eabef-31ba-424c-9290-a3594cf42842 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:52.079618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:52.080216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:52.080619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:52.080899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:52.094857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:52.096297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:52.129310 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1237/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:54.964603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d42e4-aac0-4e00-9d93-42ce8ea123fb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:54.965092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d42e4-aac0-4e00-9d93-42ce8ea123fb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:54.965187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d42e4-aac0-4e00-9d93-42ce8ea123fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:54.986396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b84d42e4-aac0-4e00-9d93-42ce8ea123fb None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:54.987717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b84d42e4-aac0-4e00-9d93-42ce8ea123fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:54.995367 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1245/2482] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:55.007147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:55.019117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281ed2-8435-4ecc-862a-6ca526aeb413 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:55.024044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:55.024629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:55.024909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:55.025182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:55.034006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:55.035576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:55.044114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1238/2483] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:02.733382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:02.734308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:02.734587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:02.753673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:02.755186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:02.763665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1246/2484] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 08:06:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:02.775736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:02.787255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650a38-80bb-40ca-aeef-a08e64fa2c2e service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:02.792279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:02.792879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:02.793217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:02.794099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:02.802805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:02.804383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:02.813320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1239/2485] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:05.106483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:05.145345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1effb6b-de34-47f1-8324-86317993fee1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:05.150198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:05.151050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.151334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.151697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] PATH_INFO: `/v3/users/19b9a5d74cf04e829c34fe22e20bb560` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.153402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b9a5d74cf04e829c34fe22e20bb560)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:05.155840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:05.187426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:05.209079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b9a5d74cf04e829c34fe22e20bb560'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.209685 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b9a5d74cf04e829c34fe22e20bb560'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.217224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b9a5d74cf04e829c34fe22e20bb560'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.230017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b9a5d74cf04e829c34fe22e20bb560'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.237866 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-2db76e7e-2d0f-4651-8eb7-3a9d44f2bbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b9a5d74cf04e829c34fe22e20bb560'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.243875 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1247/2486] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:05 2022] DELETE /identity/v3/users/19b9a5d74cf04e829c34fe22e20bb560 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:05.447615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:05.463968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f6a6-dabe-4a3a-ac72-296d65699467 service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:05.523380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:05.524012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.524289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.524556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] PATH_INFO: `/v3/projects/342c029caf2b46ff98cc1d229c498837` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.525685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] RBAC: Authorizing `identity:delete_project(project_id=342c029caf2b46ff98cc1d229c498837)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:05.527902 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:05.535885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:05.573519 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342c029caf2b46ff98cc1d229c498837', 'request_id': 'req-0fde996f-4da4-4871-8f0e-83f45280625c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.579879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342c029caf2b46ff98cc1d229c498837', 'request_id': 'req-0fde996f-4da4-4871-8f0e-83f45280625c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.586884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342c029caf2b46ff98cc1d229c498837', 'request_id': 'req-0fde996f-4da4-4871-8f0e-83f45280625c'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.609356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] The token cache is being invalidate because project 342c029caf2b46ff98cc1d229c498837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:05.609644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.610266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.611725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1240/2487] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:05 2022] DELETE /identity/v3/projects/342c029caf2b46ff98cc1d229c498837 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:15.240453 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=6,keystone:SELECT=19,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:15.607162 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:17.110532 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:17.111024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:17.111181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:17.132364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] MFA Rules not processed for user `2ed3ba8987a04008a337de0a7955237e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:17.134365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:17.204795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1248/2488] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 08:06:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:17.217941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:17.219369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:17.287708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde996f-4da4-4871-8f0e-83f45280625c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:17.292589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f9c8b7933e4742a5023154e9fd2218', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:17.293190 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:17.293498 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:17.293768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:17.301613 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:17.303111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:17.310972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1241/2489] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:27.195928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=25 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:27.307737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=32 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:27.554872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:27.556274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:27.633751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c13aa-d19d-42c0-87b8-07abd545d684 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:27.637515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:27.638152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:27.638433 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:27.638708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:27.640487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:27.702940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:27.704374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:27.713942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1249/2490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:30.606913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:30.608378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:30.623539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104556e0-8a78-4593-a64f-948c2094380f service swift] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:30.628078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:30.628706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:30.628983 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:30.629253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] PATH_INFO: `/v3/users/e8e5a0df4ec54ab495a007f8804f23b4` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:30.630385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e5a0df4ec54ab495a007f8804f23b4)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:30.632285 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:30.681870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e5a0df4ec54ab495a007f8804f23b4'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.690071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e5a0df4ec54ab495a007f8804f23b4'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.691044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e5a0df4ec54ab495a007f8804f23b4'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.703991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e5a0df4ec54ab495a007f8804f23b4'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.711444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-d4808e92-a562-4235-b78a-73cb76447e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e5a0df4ec54ab495a007f8804f23b4'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.718034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1242/2491] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:30 2022] DELETE /identity/v3/users/e8e5a0df4ec54ab495a007f8804f23b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:30.897756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:30.909673 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782f5e-80d3-4eaa-acb1-387b96f252de service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:30.968497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:30.969125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:30.969444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:30.969717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] PATH_INFO: `/v3/projects/f91ee18a75b14103ac14edef023b1ce3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:30.970825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91ee18a75b14103ac14edef023b1ce3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:30.972704 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.006396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:31.019174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91ee18a75b14103ac14edef023b1ce3', 'request_id': 'req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.025006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91ee18a75b14103ac14edef023b1ce3', 'request_id': 'req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.032613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91ee18a75b14103ac14edef023b1ce3', 'request_id': 'req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.043421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] The token cache is being invalidate because project f91ee18a75b14103ac14edef023b1ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:31.043710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.044337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ad67e1bc-37c0-43a9-8d0c-72207e87fe95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.046109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1250/2492] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:30 2022] DELETE /identity/v3/projects/f91ee18a75b14103ac14edef023b1ce3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:31.051230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.051545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.051837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.099349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:31.100565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:31.158487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1243/2493] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:31.166320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.166586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.166868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.187030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:31.188233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:31.196133 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1251/2494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:31.200327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.209972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8f82-1326-4c91-a072-e5c123a4a840 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.215010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.215594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.215870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.216137 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.216775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:31.217078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.218684 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.230610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1244/2495] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:06:31.234618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.243862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de782-4dfa-44a1-8a95-f77be894a421 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.248555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.249144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.249444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.249715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.250336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.252223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.278891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1252/2496] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:31.283074 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.293464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f37d6-829b-401a-baba-27f4310da6f5 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.325605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:31.351605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.352222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.352504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.352774 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.353439 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.355927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.375731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1245/2497] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:31.380044 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.390489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79290-1156-4b72-a97c-d07927496496 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.395158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.395754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.396031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.396304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.396932 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.398550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.409059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1253/2498] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:31.413084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.423589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e53ae-84c6-47fc-bc30-65731f8a616c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.428107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437171a-88fe-4a78-9c63-5f516d367b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.428690 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437171a-88fe-4a78-9c63-5f516d367b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.428964 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437171a-88fe-4a78-9c63-5f516d367b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.429232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437171a-88fe-4a78-9c63-5f516d367b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.429889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437171a-88fe-4a78-9c63-5f516d367b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.431450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437171a-88fe-4a78-9c63-5f516d367b5f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.441132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1246/2499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:31.445057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.455500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c86928-06eb-4f31-bcb5-b7083f12aa91 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.460269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.460911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.461188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.461515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] PATH_INFO: `/v3/projects/40fce46c00dd4db29babf9cab0c77633/users/e6c60c8b23cc435eaea8ef2623b8f101/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.476058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fce46c00dd4db29babf9cab0c77633, user_id=e6c60c8b23cc435eaea8ef2623b8f101, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.478712 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.491270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1254/2500] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:31 2022] PUT /identity/v3/projects/40fce46c00dd4db29babf9cab0c77633/users/e6c60c8b23cc435eaea8ef2623b8f101/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:31.503075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.503358 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.503626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.532354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] MFA Rules not processed for user `e6c60c8b23cc435eaea8ef2623b8f101`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:31.533514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:31.596489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1247/2501] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:31.601043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.661640 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e37b59-88c2-4dbf-b11e-88912ce01985 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.666178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.666770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.667085 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.667357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.667968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.669890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.695231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1255/2502] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:31.699906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.710925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e33e5-c044-45db-894d-a61dab78a4e0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.767110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.767717 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.767997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.768270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.768893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.770840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.791753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1248/2503] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:31.795667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.805863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505e9b-4595-47f6-9a1b-2f65deb46de4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.810446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.811033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.811308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.811574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.812203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.813814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.825549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1256/2504] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:31.829576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.839868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ad7aa-42c8-47b4-b53c-73b32581181e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.844497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.845151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.845440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.845712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] PATH_INFO: `/v3/projects/4080b81e3610409e8bd4a8d0b6329be3/users/abd1a613845d4b4e8d597e5031a7d900/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.860181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4080b81e3610409e8bd4a8d0b6329be3, user_id=abd1a613845d4b4e8d597e5031a7d900, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.862878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.875520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1249/2505] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:31 2022] PUT /identity/v3/projects/4080b81e3610409e8bd4a8d0b6329be3/users/abd1a613845d4b4e8d597e5031a7d900/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:31.879346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.890448 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da2dd4-0dd9-4a7e-9239-dee98f0998f7 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.918702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:31.955034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcea4f-ccf6-4a82-90c8-33839daa7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.955649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcea4f-ccf6-4a82-90c8-33839daa7343 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.955961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcea4f-ccf6-4a82-90c8-33839daa7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.956234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcea4f-ccf6-4a82-90c8-33839daa7343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.956869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcea4f-ccf6-4a82-90c8-33839daa7343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.958504 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcea4f-ccf6-4a82-90c8-33839daa7343 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.970032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1257/2506] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:31.974157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.984572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1736-6847-4a68-bdfc-9dbe8bb5f0e2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.989187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.989885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.990155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.990507 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] PATH_INFO: `/v3/projects/4080b81e3610409e8bd4a8d0b6329be3/users/abd1a613845d4b4e8d597e5031a7d900/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.992348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4080b81e3610409e8bd4a8d0b6329be3, user_id=abd1a613845d4b4e8d597e5031a7d900, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.995009 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:32.001019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:32.007073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1250/2507] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:31 2022] PUT /identity/v3/projects/4080b81e3610409e8bd4a8d0b6329be3/users/abd1a613845d4b4e8d597e5031a7d900/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:32.017970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:32.018618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:32.018618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:32.046805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] MFA Rules not processed for user `abd1a613845d4b4e8d597e5031a7d900`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:32.047959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:32.117799 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1258/2508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:32.129552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:32.131261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:32.210104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e836c-921b-41d1-9f56-1652a3b90577 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:32.213988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:32.214590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:32.214872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:32.215147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:32.224097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:32.225547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:32.235462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1251/2509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:32.307642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:32.317776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bd0c7-48df-472e-8360-c0b3c4fc1b1c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:32.321396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5367985-5ab0-4759-a819-ad2d1be53fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:32.321990 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5367985-5ab0-4759-a819-ad2d1be53fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:32.322269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5367985-5ab0-4759-a819-ad2d1be53fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:32.322540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5367985-5ab0-4759-a819-ad2d1be53fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:32.378419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5367985-5ab0-4759-a819-ad2d1be53fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:32.379886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5367985-5ab0-4759-a819-ad2d1be53fd9 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:32.388794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1259/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:39.158273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:39.234038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647f10b-c69f-411a-bc83-188355a9d13b service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:39.238523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:39.239144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:39.239427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:39.239702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] PATH_INFO: `/v3/users/e6c60c8b23cc435eaea8ef2623b8f101` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:39.240808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c60c8b23cc435eaea8ef2623b8f101)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:39.242738 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:39.288385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c60c8b23cc435eaea8ef2623b8f101'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.314838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c60c8b23cc435eaea8ef2623b8f101'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.315447 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c60c8b23cc435eaea8ef2623b8f101'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.327855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c60c8b23cc435eaea8ef2623b8f101'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.334758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c60c8b23cc435eaea8ef2623b8f101'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.337486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:39.342753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1252/2511] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:39 2022] DELETE /identity/v3/users/e6c60c8b23cc435eaea8ef2623b8f101 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:39.350881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:39.351720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:39.352058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:39.371566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:39.372776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:39.416280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:39.430764 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1260/2512] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:39.440931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:39.442368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:39.506777 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cdd18-77dc-4198-84a8-683b68df2fc7 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:39.512407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:39.513466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:39.514348 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:39.514623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:39.523457 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:39.524865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:39.534380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1253/2513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:39.801233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:39.802729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:39.815621 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff77199-6d52-44ec-a3f3-a39cb3928af0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:39.820437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:39.821089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:39.821409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:39.821689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] PATH_INFO: `/v3/projects/40fce46c00dd4db29babf9cab0c77633` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:39.822862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fce46c00dd4db29babf9cab0c77633)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:39.824930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:39.875947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fce46c00dd4db29babf9cab0c77633', 'request_id': 'req-be308e6c-e726-4f44-af19-c8576852f7f2'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.882030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fce46c00dd4db29babf9cab0c77633', 'request_id': 'req-be308e6c-e726-4f44-af19-c8576852f7f2'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.890974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fce46c00dd4db29babf9cab0c77633', 'request_id': 'req-be308e6c-e726-4f44-af19-c8576852f7f2'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.902247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] The token cache is being invalidate because project 40fce46c00dd4db29babf9cab0c77633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:39.902540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.903171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:39.904664 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1261/2514] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:39 2022] DELETE /identity/v3/projects/40fce46c00dd4db29babf9cab0c77633 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:39.908620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:39.918940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5b84-b98d-4a88-99de-732a22421065 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:39.973558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:39.974164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:39.974445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:39.974718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] PATH_INFO: `/v3/users/abd1a613845d4b4e8d597e5031a7d900` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:39.975815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd1a613845d4b4e8d597e5031a7d900)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:39.977772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.022730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd1a613845d4b4e8d597e5031a7d900'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.030465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd1a613845d4b4e8d597e5031a7d900'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.031241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd1a613845d4b4e8d597e5031a7d900'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.043660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd1a613845d4b4e8d597e5031a7d900'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.050420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-dc828c3d-82ac-4217-95e4-44a0df1682ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd1a613845d4b4e8d597e5031a7d900'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.056392 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1254/2515] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:39 2022] DELETE /identity/v3/users/abd1a613845d4b4e8d597e5031a7d900 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:40.332788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.334245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:40.349206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be308e6c-e726-4f44-af19-c8576852f7f2 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.410857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.411513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.411792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.412063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] PATH_INFO: `/v3/projects/4080b81e3610409e8bd4a8d0b6329be3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.413193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4080b81e3610409e8bd4a8d0b6329be3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.415175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.459913 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4080b81e3610409e8bd4a8d0b6329be3', 'request_id': 'req-1014e097-1907-4cac-8e6f-7f41de197301'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.466502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4080b81e3610409e8bd4a8d0b6329be3', 'request_id': 'req-1014e097-1907-4cac-8e6f-7f41de197301'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.474391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4080b81e3610409e8bd4a8d0b6329be3', 'request_id': 'req-1014e097-1907-4cac-8e6f-7f41de197301'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.484747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] The token cache is being invalidate because project 4080b81e3610409e8bd4a8d0b6329be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:40.485042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.485774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1014e097-1907-4cac-8e6f-7f41de197301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:40.487279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1262/2516] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:40 2022] DELETE /identity/v3/projects/4080b81e3610409e8bd4a8d0b6329be3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:40.492357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.492822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.492926 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.512761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:40.513982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:40.531141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:40.578140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1255/2517] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:40.586208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.586489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.586762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.595758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:40.607296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:40.608969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:40.617009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1263/2518] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:40.621116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.630700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d200-4fd9-4c06-9d73-bd425dfde778 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.635135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.636248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.636523 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.636790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.637456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:40.637753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.639426 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.650607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1256/2519] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:06:40.655513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.664607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330754a-7e38-4ad5-9dbc-47300225c3bd None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.669287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.669883 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.670163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.670437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.671054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.672940 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.699495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1264/2520] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:40 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:40.703563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.713396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138035e8-cbf4-4561-9534-8257dedf03a1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.768062 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.768680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.768954 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.769228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.769950 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.771855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.793091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1257/2521] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:40 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:40.797149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.807507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27686b-f863-48ef-b74d-f8fa0850d34c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.812083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.812684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.812961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.813233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.813917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.815501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.827628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1265/2522] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:40.831663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.842269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc270b-3a6c-4f3b-964e-04db1c5e4f62 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.846958 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946190f-b736-41ce-92be-59c5b885260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.847551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946190f-b736-41ce-92be-59c5b885260c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.847832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946190f-b736-41ce-92be-59c5b885260c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.848106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946190f-b736-41ce-92be-59c5b885260c admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.848736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946190f-b736-41ce-92be-59c5b885260c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.850355 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946190f-b736-41ce-92be-59c5b885260c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.860960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1258/2523] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:40.864941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:40.875878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd59c48-c306-45f9-a431-13821cfe00e9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:40.880438 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:40.881082 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.881397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.881671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] PATH_INFO: `/v3/projects/40e3dce4d19841a6b133ca9014c2cf52/users/63307b6d0438420bb82ba297f3dd5ac8/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.897857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e3dce4d19841a6b133ca9014c2cf52, user_id=63307b6d0438420bb82ba297f3dd5ac8, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:40.900449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:40.912652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1266/2524] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:40 2022] PUT /identity/v3/projects/40e3dce4d19841a6b133ca9014c2cf52/users/63307b6d0438420bb82ba297f3dd5ac8/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:40.924039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:40.924318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:40.924612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:40.951998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] MFA Rules not processed for user `63307b6d0438420bb82ba297f3dd5ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:40.953179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:41.014638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1259/2525] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:41.019055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.080103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f00ea-d9fd-4fe3-ba29-b8e49fb0faa3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.084791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.085354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.085635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.085963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.086638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.088666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.113968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1267/2526] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:41 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:41.118077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.129185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31397ebd-fc7c-45b0-a21c-cd5e5dedf71f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.141733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:41.186448 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.187064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.187344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.187615 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.188225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.190182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.211856 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1260/2527] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:41.215815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.225921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f25db-1024-472b-b420-2cd5cdf32391 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.231043 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.231639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.231916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.232186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.232810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.234432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.244715 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1268/2528] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:41.249187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.259201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e8e6c-7910-48f5-ac52-7b940e1c7736 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.263890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.264531 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.264810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.265084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] PATH_INFO: `/v3/projects/27ea5b3538be43c5bef86ef6f98a0ee4/users/582e3faecfdd4868ae8d734ef5018d1e/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.279681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ea5b3538be43c5bef86ef6f98a0ee4, user_id=582e3faecfdd4868ae8d734ef5018d1e, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.282350 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.295526 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1261/2529] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:41 2022] PUT /identity/v3/projects/27ea5b3538be43c5bef86ef6f98a0ee4/users/582e3faecfdd4868ae8d734ef5018d1e/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:41.299386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.309790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfb411-ed94-4719-acbd-acaa59b17718 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.364948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9179-b1cc-4536-876e-cdc72dd43d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.365625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9179-b1cc-4536-876e-cdc72dd43d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.365974 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9179-b1cc-4536-876e-cdc72dd43d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.366318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9179-b1cc-4536-876e-cdc72dd43d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.366868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9179-b1cc-4536-876e-cdc72dd43d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.368452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9179-b1cc-4536-876e-cdc72dd43d14 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.378809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1269/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:41.382982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.393246 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8a90-d13d-4684-bdac-0fe10578f219 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.397859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.398501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.398782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.399056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] PATH_INFO: `/v3/projects/27ea5b3538be43c5bef86ef6f98a0ee4/users/582e3faecfdd4868ae8d734ef5018d1e/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.400914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ea5b3538be43c5bef86ef6f98a0ee4, user_id=582e3faecfdd4868ae8d734ef5018d1e, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.403941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.414142 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1262/2531] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:41 2022] PUT /identity/v3/projects/27ea5b3538be43c5bef86ef6f98a0ee4/users/582e3faecfdd4868ae8d734ef5018d1e/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:41.424849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.425390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.425509 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.445936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:41.453825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] MFA Rules not processed for user `582e3faecfdd4868ae8d734ef5018d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:41.455473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:41.522569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1270/2532] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:41.535593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.537309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:41.596035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c57b-451c-4cb7-b68b-3ac2ca8984db admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.599883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.600484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.600757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.601021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.611679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.613115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.622800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1263/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:41.696402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:41.705906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe3d4-a463-4101-ad68-d04fca44b8f4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:41.709725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f4249-38ef-4212-8a59-cda8c0a5fbc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:41.710329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f4249-38ef-4212-8a59-cda8c0a5fbc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:41.710609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f4249-38ef-4212-8a59-cda8c0a5fbc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:41.710881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f4249-38ef-4212-8a59-cda8c0a5fbc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:41.766829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f4249-38ef-4212-8a59-cda8c0a5fbc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:41.768288 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f4249-38ef-4212-8a59-cda8c0a5fbc1 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:41.777735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1271/2534] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:44.634197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:44.695214 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6bc88-416c-418a-974f-865b0ac8a537 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:44.699795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:44.700413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:44.700692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:44.700962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] PATH_INFO: `/v3/users/63307b6d0438420bb82ba297f3dd5ac8` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:44.702097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=63307b6d0438420bb82ba297f3dd5ac8)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:44.703993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:44.717565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:44.751534 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63307b6d0438420bb82ba297f3dd5ac8'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:44.758678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63307b6d0438420bb82ba297f3dd5ac8'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:44.759305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63307b6d0438420bb82ba297f3dd5ac8'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:44.770923 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63307b6d0438420bb82ba297f3dd5ac8'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:44.778405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63307b6d0438420bb82ba297f3dd5ac8'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:44.784097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1264/2535] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:44 2022] DELETE /identity/v3/users/63307b6d0438420bb82ba297f3dd5ac8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:44.788524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:44.789001 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:44.789107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:44.808126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:44.809350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:44.866297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1272/2536] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:44.876197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:44.877650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:44.935480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa6e76-6144-4a7c-9b4e-6aba39736ccb admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:44.939079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:44.939677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:44.939957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:44.940227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:44.949549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:44.950967 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:44.960150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1265/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:45.233319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:45.234916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:45.248454 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7fea-2c79-4eed-b2d4-137816105814 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:45.253125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:45.253809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:45.254093 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:45.254369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] PATH_INFO: `/v3/projects/40e3dce4d19841a6b133ca9014c2cf52` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:45.255536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e3dce4d19841a6b133ca9014c2cf52)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:45.257512 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:45.298657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:45.313429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e3dce4d19841a6b133ca9014c2cf52', 'request_id': 'req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.319842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e3dce4d19841a6b133ca9014c2cf52', 'request_id': 'req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.327862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e3dce4d19841a6b133ca9014c2cf52', 'request_id': 'req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.340777 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] The token cache is being invalidate because project 40e3dce4d19841a6b133ca9014c2cf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:45.341152 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.341858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.343382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1273/2538] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:45 2022] DELETE /identity/v3/projects/40e3dce4d19841a6b133ca9014c2cf52 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:45.348558 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:45.361826 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4fca-27bd-4510-be53-81869a1bc720 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:45.421831 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:45.422595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:45.422869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:45.423135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] PATH_INFO: `/v3/users/582e3faecfdd4868ae8d734ef5018d1e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:45.424264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=582e3faecfdd4868ae8d734ef5018d1e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:45.426227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:45.466551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:45.476315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582e3faecfdd4868ae8d734ef5018d1e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.485040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582e3faecfdd4868ae8d734ef5018d1e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.485799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582e3faecfdd4868ae8d734ef5018d1e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.498636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582e3faecfdd4868ae8d734ef5018d1e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.505824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-53374fad-6d17-45b5-bcdd-448acf462aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582e3faecfdd4868ae8d734ef5018d1e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:45.511735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1266/2539] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:45 2022] DELETE /identity/v3/users/582e3faecfdd4868ae8d734ef5018d1e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:45.909312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:45.910928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:45.928022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b2a23-fd81-4bfd-aa76-e9fe0f75952a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:45.998120 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:45.998850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:45.999128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:45.999398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] PATH_INFO: `/v3/projects/27ea5b3538be43c5bef86ef6f98a0ee4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.000513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ea5b3538be43c5bef86ef6f98a0ee4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.002506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.052046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ea5b3538be43c5bef86ef6f98a0ee4', 'request_id': 'req-a15b863f-1d52-45dc-bd12-8cb77e7f4882'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:46.058755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ea5b3538be43c5bef86ef6f98a0ee4', 'request_id': 'req-a15b863f-1d52-45dc-bd12-8cb77e7f4882'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:46.065825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ea5b3538be43c5bef86ef6f98a0ee4', 'request_id': 'req-a15b863f-1d52-45dc-bd12-8cb77e7f4882'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:46.076561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] The token cache is being invalidate because project 27ea5b3538be43c5bef86ef6f98a0ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:46.076847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:46.077486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a15b863f-1d52-45dc-bd12-8cb77e7f4882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:46.078967 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1274/2540] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:45 2022] DELETE /identity/v3/projects/27ea5b3538be43c5bef86ef6f98a0ee4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:46.083820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.084324 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.084427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.104187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:46.105419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:46.163599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1267/2541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:46.172319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.172605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.172906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.194414 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:46.195619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:46.204157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1275/2542] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:46.208404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.218483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9e97e-3389-4ea3-b4d7-6d706e169a9c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.223022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.223616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.223899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.224168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.224800 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:46.225091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.226711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.239019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1268/2543] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:06:46.243277 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.252691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a052-8205-48d2-a7e9-365d44acff53 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.257282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.257887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.258161 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.258428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.259050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.260969 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.264945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.266692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:46.293599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1276/2544] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:46.295003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.316467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:46.363419 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0fd3-8df9-4ddf-abb5-6766fe5e89c6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.366864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fef820-862e-4fbd-bd17-5279d9bc461f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.372192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.372801 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.373080 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.373381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.374000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.376196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.383888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:46.398388 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1277/2545] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:46.404634 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.415274 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaf707-46f3-4a4a-91d5-92b9fa372a88 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.421068 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.421696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.421978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.422250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.422878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.424455 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.431631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.432273 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.432555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.432857 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.434624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:46.435517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1278/2546] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:06:46.439416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.446220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.448364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.449521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601d975-5c10-4627-8412-831c9e55e075 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.454169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976da36-f9c4-4011-aa22-452ac7875dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.454750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976da36-f9c4-4011-aa22-452ac7875dba admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.455026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976da36-f9c4-4011-aa22-452ac7875dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.455295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976da36-f9c4-4011-aa22-452ac7875dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.455968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976da36-f9c4-4011-aa22-452ac7875dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.457542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976da36-f9c4-4011-aa22-452ac7875dba admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.458899 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1269/2547] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:06:46.468292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1279/2548] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:06:46.472480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.483637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320587cf-09c1-4d71-a38f-ba508e2f4566 service placement] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.488404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.489050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.489434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.489712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] PATH_INFO: `/v3/projects/05a9a764fcde4110af76bd4a9aae7f04/users/18fd93652ada46db87edda02831ed7ac/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.504016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a9a764fcde4110af76bd4a9aae7f04, user_id=18fd93652ada46db87edda02831ed7ac, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.506645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.520999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1270/2549] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:46 2022] PUT /identity/v3/projects/05a9a764fcde4110af76bd4a9aae7f04/users/18fd93652ada46db87edda02831ed7ac/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:46.532849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.533141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.533458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.562150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] MFA Rules not processed for user `18fd93652ada46db87edda02831ed7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:46.563374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:46.628686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1280/2550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:46.633399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.696489 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adca9df-4c12-4514-8a87-814cd1bc7f01 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.701888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.702478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.702764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.703040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.703661 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.705586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.731636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1271/2551] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:46.735855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.746343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e3177-33e2-4f7f-993c-f39938180b8d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.801046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.801597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.801873 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.802169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.802790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.804681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.825931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1281/2552] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:46 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:46.829887 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.840644 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04b75-54b8-44b0-bc65-051066dc56e4 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.845363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.845952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.846231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.846502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.847129 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.848703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.859018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1272/2553] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:46.862984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.873591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a26cc-4c05-451d-8514-a1949cf8db90 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.878293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.878943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.879224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.879500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] PATH_INFO: `/v3/projects/8caa3e0291884ec3a1e2fa73e9578443/users/8be09befdfff4fd2be061beba3dfbbf7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.881728 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:46.898375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa3e0291884ec3a1e2fa73e9578443, user_id=8be09befdfff4fd2be061beba3dfbbf7, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.901041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.914824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1282/2554] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:46 2022] PUT /identity/v3/projects/8caa3e0291884ec3a1e2fa73e9578443/users/8be09befdfff4fd2be061beba3dfbbf7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:46.918805 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:46.928797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8bd9-9e46-4544-af02-0adcec9e6266 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.983164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a215d-cb5c-40bb-9523-136c89b35399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.983760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a215d-cb5c-40bb-9523-136c89b35399 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.984036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a215d-cb5c-40bb-9523-136c89b35399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.984303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a215d-cb5c-40bb-9523-136c89b35399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.984919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a215d-cb5c-40bb-9523-136c89b35399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.986555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a215d-cb5c-40bb-9523-136c89b35399 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.991488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:47.000073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1273/2555] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:47.001150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:47.011760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fffe-958b-4edd-bfb1-3cb8390cbda3 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:47.016257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:47.016895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:47.017171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:47.017467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] PATH_INFO: `/v3/projects/8caa3e0291884ec3a1e2fa73e9578443/users/8be09befdfff4fd2be061beba3dfbbf7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:47.019344 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa3e0291884ec3a1e2fa73e9578443, user_id=8be09befdfff4fd2be061beba3dfbbf7, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:47.021991 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:47.032092 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1283/2556] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:47 2022] PUT /identity/v3/projects/8caa3e0291884ec3a1e2fa73e9578443/users/8be09befdfff4fd2be061beba3dfbbf7/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:47.042079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:47.042365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:47.042642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:47.070363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] MFA Rules not processed for user `8be09befdfff4fd2be061beba3dfbbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:47.071634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:47.140364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1274/2557] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:47.151418 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:47.153365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:47.210081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069240-6343-41db-9ba6-7cb32872d182 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:47.213757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:47.214371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:47.214661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:47.214911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:47.224026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:47.225492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:47.235322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1284/2558] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:47.280611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:47.282059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:47.294722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afd8e2-f3b6-42a6-b0e2-4c1906038c2c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:47.298367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d720426-6e77-462c-a42c-2043e0d5d178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:47.298960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d720426-6e77-462c-a42c-2043e0d5d178 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:47.299241 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d720426-6e77-462c-a42c-2043e0d5d178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:47.299515 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d720426-6e77-462c-a42c-2043e0d5d178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:47.358665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d720426-6e77-462c-a42c-2043e0d5d178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:47.360100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d720426-6e77-462c-a42c-2043e0d5d178 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:47.368945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1275/2559] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:50.652930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:50.713055 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261932a0-dde9-4f6b-ad43-c79cbc8de843 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:50.718091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:50.718709 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:50.718989 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:50.719263 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] PATH_INFO: `/v3/users/18fd93652ada46db87edda02831ed7ac` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:50.720376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fd93652ada46db87edda02831ed7ac)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:50.722333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:50.766468 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fd93652ada46db87edda02831ed7ac'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:50.767110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fd93652ada46db87edda02831ed7ac'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:50.774413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fd93652ada46db87edda02831ed7ac'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:50.787364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fd93652ada46db87edda02831ed7ac'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:50.789468 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:50.797226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fd93652ada46db87edda02831ed7ac'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:50.803604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1285/2560] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:50 2022] DELETE /identity/v3/users/18fd93652ada46db87edda02831ed7ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:50.808157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:50.808667 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:50.808766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:50.827192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:50.828384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:50.884678 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1276/2561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:50.895469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:50.896898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:50.952891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf5a9-c2bb-4694-aebf-58065aaa1a5c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:50.956497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:50.957089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:50.957397 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:50.957670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:50.966573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:50.967930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:50.977310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1286/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:51.247353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:51.248859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:51.261984 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d23e-b613-4a4f-878a-98ecbb91bb7b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:51.266892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:51.267533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.267812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.268085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] PATH_INFO: `/v3/projects/05a9a764fcde4110af76bd4a9aae7f04` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.269218 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a9a764fcde4110af76bd4a9aae7f04)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:51.271143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:51.293624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:51.318614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a9a764fcde4110af76bd4a9aae7f04', 'request_id': 'req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.324598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a9a764fcde4110af76bd4a9aae7f04', 'request_id': 'req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.332087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a9a764fcde4110af76bd4a9aae7f04', 'request_id': 'req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.343356 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] The token cache is being invalidate because project 05a9a764fcde4110af76bd4a9aae7f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:51.343646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.344496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.345884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1277/2563] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:51 2022] DELETE /identity/v3/projects/05a9a764fcde4110af76bd4a9aae7f04 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:51.350232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:51.360618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11692-7119-4960-a556-25a802859de5 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:51.417156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:51.417831 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.418112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.418382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] PATH_INFO: `/v3/users/8be09befdfff4fd2be061beba3dfbbf7` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.419499 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be09befdfff4fd2be061beba3dfbbf7)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:51.421440 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:51.466560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be09befdfff4fd2be061beba3dfbbf7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.467216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be09befdfff4fd2be061beba3dfbbf7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.474026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be09befdfff4fd2be061beba3dfbbf7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.486559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be09befdfff4fd2be061beba3dfbbf7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.493406 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c038dcdd-a1c9-46ab-8514-7315fb376e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be09befdfff4fd2be061beba3dfbbf7'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.499126 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1287/2564] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:51 2022] DELETE /identity/v3/users/8be09befdfff4fd2be061beba3dfbbf7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:51.762227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:51.763689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:51.778187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008b73-c9c3-4bc1-9bef-a046ba09a1eb admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:51.833649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:51.834276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.834544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.834818 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] PATH_INFO: `/v3/projects/8caa3e0291884ec3a1e2fa73e9578443` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.835925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caa3e0291884ec3a1e2fa73e9578443)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:51.837867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:51.884196 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caa3e0291884ec3a1e2fa73e9578443', 'request_id': 'req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.891326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caa3e0291884ec3a1e2fa73e9578443', 'request_id': 'req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.898587 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caa3e0291884ec3a1e2fa73e9578443', 'request_id': 'req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.909464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] The token cache is being invalidate because project 8caa3e0291884ec3a1e2fa73e9578443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:51.909750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.910401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-bb36e28d-19f2-4630-8b29-6cff68a1e4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:51.911846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1278/2565] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:51 2022] DELETE /identity/v3/projects/8caa3e0291884ec3a1e2fa73e9578443 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:51.917147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.917651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.917751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.937180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:51.938400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:51.946560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:51.999026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1288/2566] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:52.007975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.008205 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.008480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.028136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:52.029369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:52.037179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1279/2567] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:52.041900 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.051466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b3ae4-dcfb-45de-ab13-5b435d8ec115 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.056049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.056645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.056972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.057770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.058437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:52.058741 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.060324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.071591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1289/2568] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:06:52.076221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.085626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b8cf2-6d90-48e1-b1ca-9a727a3a8471 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.091075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.091662 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.091940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.092212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.092827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.094741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.121542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1280/2569] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:52.125566 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.135870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee7c1c-304e-49f5-912a-cd289bc2fc4f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.190919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.191517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.191802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.192076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.192699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.194629 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.215770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1290/2570] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:52.219809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.229921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860c3c5-4887-4913-9004-f2b13b5556df admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.234812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.235412 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.235692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.235965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.236679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.238259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.240344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:52.250110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1281/2571] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:52.253547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.264122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9313-a976-4b8a-9d52-83608b927ab1 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.268719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca56363-b4a9-4b4a-bff4-d8cc57381939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.269348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56363-b4a9-4b4a-bff4-d8cc57381939 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.269631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56363-b4a9-4b4a-bff4-d8cc57381939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.269904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56363-b4a9-4b4a-bff4-d8cc57381939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.270543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca56363-b4a9-4b4a-bff4-d8cc57381939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.272115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca56363-b4a9-4b4a-bff4-d8cc57381939 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.282849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1291/2572] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:52.287060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.296942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773828e-61c9-49eb-961d-bdff14b08c68 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.301530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.302165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.302441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.302708 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] PATH_INFO: `/v3/projects/a19f4efb5ed84baa84cc7d810a05c39e/users/b7b6a4de02f74a78a686cd67fa447ada/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.317913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19f4efb5ed84baa84cc7d810a05c39e, user_id=b7b6a4de02f74a78a686cd67fa447ada, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.320546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.333962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1282/2573] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:52 2022] PUT /identity/v3/projects/a19f4efb5ed84baa84cc7d810a05c39e/users/b7b6a4de02f74a78a686cd67fa447ada/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:52.344214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.344518 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.344804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.372452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] MFA Rules not processed for user `b7b6a4de02f74a78a686cd67fa447ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:52.373993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:52.436556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1292/2574] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:52.441113 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.502442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d778-2cf1-4111-aa0e-7d8f46614df8 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.507165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.507793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.508071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.508340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.508956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.510874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.537484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1283/2575] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:52.541925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.552463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759cc2-86a1-4f3a-a1ac-4743698b2fd1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.557583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:52.609115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.609748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.610027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.610301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.610923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.612818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.633753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1293/2576] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:52.637786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.647872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7c18-2386-4ce5-8056-2970f61773fc admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.652711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.653337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.653619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.653888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.654511 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.656096 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.667053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1284/2577] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:52.671138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.681540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d238a-14aa-4df5-9048-7c3f47422abb admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.686707 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.687350 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.687738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.688016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] PATH_INFO: `/v3/projects/2cbb1777f3e44939ac48fc418821aebc/users/e2f30d37d4eb46fdbed87f3293d3ee6c/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.702861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb1777f3e44939ac48fc418821aebc, user_id=e2f30d37d4eb46fdbed87f3293d3ee6c, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.705517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.718207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1294/2578] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:52 2022] PUT /identity/v3/projects/2cbb1777f3e44939ac48fc418821aebc/users/e2f30d37d4eb46fdbed87f3293d3ee6c/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:52.722230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.732163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec9fb-e752-4636-880e-616fc2f2407f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.789185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74807e-3a91-4762-9c77-28015ab40811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.789752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74807e-3a91-4762-9c77-28015ab40811 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.790032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74807e-3a91-4762-9c77-28015ab40811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.790305 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74807e-3a91-4762-9c77-28015ab40811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.790929 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74807e-3a91-4762-9c77-28015ab40811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.792505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74807e-3a91-4762-9c77-28015ab40811 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.802170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1285/2579] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:52.806296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.816412 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11b92-af79-4e4d-bb10-9fb9e078040d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.820983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.821660 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.821941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.822215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] PATH_INFO: `/v3/projects/2cbb1777f3e44939ac48fc418821aebc/users/e2f30d37d4eb46fdbed87f3293d3ee6c/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.824622 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb1777f3e44939ac48fc418821aebc, user_id=e2f30d37d4eb46fdbed87f3293d3ee6c, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.827250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.837421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1295/2580] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:52 2022] PUT /identity/v3/projects/2cbb1777f3e44939ac48fc418821aebc/users/e2f30d37d4eb46fdbed87f3293d3ee6c/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:52.848002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.848459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.848577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.875756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] MFA Rules not processed for user `e2f30d37d4eb46fdbed87f3293d3ee6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:52.876972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:52.910461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:52.946707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1286/2581] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:52.958058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.959832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:53.016770 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4742-9bff-4bfb-bd11-acbc4ade8fc0 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:53.020380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:53.020977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:53.021273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:53.021570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:53.030609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:53.032014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:53.041289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1296/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:53.141122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:53.150709 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ca50e-abad-4633-b42f-df4663e6eab9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:53.154585 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc45e-4b57-4b81-b900-15fb07d25f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:53.155179 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc45e-4b57-4b81-b900-15fb07d25f41 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:53.155461 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc45e-4b57-4b81-b900-15fb07d25f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:53.155733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc45e-4b57-4b81-b900-15fb07d25f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:53.212556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcc45e-4b57-4b81-b900-15fb07d25f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:53.214053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcc45e-4b57-4b81-b900-15fb07d25f41 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:53.222908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1287/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:55.785382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:55.846829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9727ba-ef8f-47bf-8ebc-9cb858ffa8f1 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:55.851382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:55.851998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:55.852272 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:55.852539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] PATH_INFO: `/v3/users/b7b6a4de02f74a78a686cd67fa447ada` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:55.853674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b6a4de02f74a78a686cd67fa447ada)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:55.855568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:55.859964 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:55.904398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b6a4de02f74a78a686cd67fa447ada'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:55.905056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b6a4de02f74a78a686cd67fa447ada'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:55.912285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b6a4de02f74a78a686cd67fa447ada'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:55.924101 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b6a4de02f74a78a686cd67fa447ada'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:55.930918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b6a4de02f74a78a686cd67fa447ada'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:55.937316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1297/2584] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:55 2022] DELETE /identity/v3/users/b7b6a4de02f74a78a686cd67fa447ada => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:55.941943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:55.942441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:55.942546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:55.961750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:55.962956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:56.020453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1288/2585] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:56.031300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:56.032747 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:56.089383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fe82c-c12b-4b26-b99e-e0f6a1d286b5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:56.093034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:56.093667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:56.093946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:56.094214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:56.103027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:56.104484 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:56.113839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1298/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:56.384340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:56.385931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:56.398711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af8b45-0808-46a2-b516-3d778d35e52a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:56.403833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:56.404467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:56.404748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:56.405021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] PATH_INFO: `/v3/projects/a19f4efb5ed84baa84cc7d810a05c39e` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:56.406202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19f4efb5ed84baa84cc7d810a05c39e)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:56.408115 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:56.455522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19f4efb5ed84baa84cc7d810a05c39e', 'request_id': 'req-5176b454-72ca-47bc-befe-f26bc18209b6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.461559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19f4efb5ed84baa84cc7d810a05c39e', 'request_id': 'req-5176b454-72ca-47bc-befe-f26bc18209b6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.468758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19f4efb5ed84baa84cc7d810a05c39e', 'request_id': 'req-5176b454-72ca-47bc-befe-f26bc18209b6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.471122 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:56.482042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] The token cache is being invalidate because project a19f4efb5ed84baa84cc7d810a05c39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:56.482326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.482955 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.484430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1289/2587] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:56 2022] DELETE /identity/v3/projects/a19f4efb5ed84baa84cc7d810a05c39e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:56.488467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:56.498726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b14696-756b-4f02-8990-dd256db9ded8 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:56.554067 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:56.554619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:56.554897 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:56.555169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] PATH_INFO: `/v3/users/e2f30d37d4eb46fdbed87f3293d3ee6c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:56.556275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f30d37d4eb46fdbed87f3293d3ee6c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:56.558736 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:56.586466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:56.605243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f30d37d4eb46fdbed87f3293d3ee6c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.605911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f30d37d4eb46fdbed87f3293d3ee6c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.612857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f30d37d4eb46fdbed87f3293d3ee6c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.624490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f30d37d4eb46fdbed87f3293d3ee6c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.631284 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4ee2082c-46e6-40ec-abf0-de40b9c00f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f30d37d4eb46fdbed87f3293d3ee6c'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:56.638009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1299/2588] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:56 2022] DELETE /identity/v3/users/e2f30d37d4eb46fdbed87f3293d3ee6c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:56.907235 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:56.908681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:56.923264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176b454-72ca-47bc-befe-f26bc18209b6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:56.981067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:56.981770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:56.981992 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:56.982267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] PATH_INFO: `/v3/projects/2cbb1777f3e44939ac48fc418821aebc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:56.983379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbb1777f3e44939ac48fc418821aebc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:56.985284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.031653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbb1777f3e44939ac48fc418821aebc', 'request_id': 'req-46bdfa33-803d-45fa-a6fd-6f727d99d425'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.037643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbb1777f3e44939ac48fc418821aebc', 'request_id': 'req-46bdfa33-803d-45fa-a6fd-6f727d99d425'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.045752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbb1777f3e44939ac48fc418821aebc', 'request_id': 'req-46bdfa33-803d-45fa-a6fd-6f727d99d425'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.055968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] The token cache is being invalidate because project 2cbb1777f3e44939ac48fc418821aebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:57.056252 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.057532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-46bdfa33-803d-45fa-a6fd-6f727d99d425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.059126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1290/2589] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:56 2022] DELETE /identity/v3/projects/2cbb1777f3e44939ac48fc418821aebc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:57.064074 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.064552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.064651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.084110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:57.085223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:57.141645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1300/2590] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:57.149432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.149736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.150024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.169953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:57.171147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:57.179033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1291/2591] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:57.183313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.192846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806f5cc-d6c2-48fd-8704-5dc829dffa59 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.197888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.198474 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.198750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.199022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.199674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:57.199970 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.201564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.213069 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1301/2592] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:06:57.217945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.227152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381f16d-8c04-4330-82f5-43003ddfc993 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.231894 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.232487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.232769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.233075 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.233760 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.235630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.263017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1292/2593] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:57 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:57.266960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.277923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098bc7-f151-4805-bc73-f07be389f303 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.331617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.332214 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.332489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.332756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.333398 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.335330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.358850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1302/2594] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:57 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:57.362977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.373787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767718d4-04d1-4c93-8a0c-78b87ccb8ce3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.378403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.379014 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.379278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.379554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.380187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.381794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.392105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1293/2595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:57.395937 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.405962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703864-f1fe-4746-aa8a-29badebd530c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.410450 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be8d87-32f9-4214-a99d-746e52dee9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.411033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be8d87-32f9-4214-a99d-746e52dee9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.411309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be8d87-32f9-4214-a99d-746e52dee9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.411580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be8d87-32f9-4214-a99d-746e52dee9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.412204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be8d87-32f9-4214-a99d-746e52dee9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.413809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be8d87-32f9-4214-a99d-746e52dee9d7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.424171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1303/2596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:57.428012 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.438380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101e7e-edad-45b9-a9d2-78f9b8b7d11c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.443008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.443668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.443928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.444202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] PATH_INFO: `/v3/projects/2d7166cb05e745408ceb6df34a5ac548/users/97d9b56c313d4fa393f0f4231563de37/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.459104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7166cb05e745408ceb6df34a5ac548, user_id=97d9b56c313d4fa393f0f4231563de37, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.461752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.474380 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1294/2597] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:57 2022] PUT /identity/v3/projects/2d7166cb05e745408ceb6df34a5ac548/users/97d9b56c313d4fa393f0f4231563de37/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:57.485305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.485592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.485914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.506057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:57.514558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] MFA Rules not processed for user `97d9b56c313d4fa393f0f4231563de37`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:57.516111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:57.578847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1304/2598] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:57.590176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.592216 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:57.611915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:57.652288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164d38-cc1e-4987-a9be-0ea6413e4c4e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.655980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c960a-049d-49b6-a226-996be2e30640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.656580 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c960a-049d-49b6-a226-996be2e30640 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.656862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c960a-049d-49b6-a226-996be2e30640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.657135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c960a-049d-49b6-a226-996be2e30640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.665521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c960a-049d-49b6-a226-996be2e30640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.666968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c960a-049d-49b6-a226-996be2e30640 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.675795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1295/2599] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:06:57.700334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.762187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e9098-c1da-4971-a30b-34afd78d901a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:57.766839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:57.767494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.767784 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.768056 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] PATH_INFO: `/v3/users/97d9b56c313d4fa393f0f4231563de37` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.769195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d9b56c313d4fa393f0f4231563de37)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:57.771157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:57.821171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d9b56c313d4fa393f0f4231563de37'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.821848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d9b56c313d4fa393f0f4231563de37'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.828916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d9b56c313d4fa393f0f4231563de37'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.840944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d9b56c313d4fa393f0f4231563de37'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.847716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d9b56c313d4fa393f0f4231563de37'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:57.854014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1305/2600] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:57 2022] DELETE /identity/v3/users/97d9b56c313d4fa393f0f4231563de37 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:57.858563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:57.858852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:57.859128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:57.878452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:57.879645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:57.938635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1296/2601] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:57.948229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:57.949730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:57.971826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:58.008888 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f199-b074-4915-b835-ac2a3388804a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.012559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53519d0-2951-4341-ba52-7c59c00968ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.013165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53519d0-2951-4341-ba52-7c59c00968ae service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.013471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53519d0-2951-4341-ba52-7c59c00968ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.013745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53519d0-2951-4341-ba52-7c59c00968ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.022507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53519d0-2951-4341-ba52-7c59c00968ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.023938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53519d0-2951-4341-ba52-7c59c00968ae service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.033527 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1306/2602] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:58.298537 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.300302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.312617 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949925-8c45-4cca-b510-4428c60f2dd7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.317734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.318365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.318646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.318918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] PATH_INFO: `/v3/projects/2d7166cb05e745408ceb6df34a5ac548` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.320023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7166cb05e745408ceb6df34a5ac548)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.321971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.370117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7166cb05e745408ceb6df34a5ac548', 'request_id': 'req-2de10745-d46a-461f-88ec-56f2f6703b7d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:58.376636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7166cb05e745408ceb6df34a5ac548', 'request_id': 'req-2de10745-d46a-461f-88ec-56f2f6703b7d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:58.384282 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7166cb05e745408ceb6df34a5ac548', 'request_id': 'req-2de10745-d46a-461f-88ec-56f2f6703b7d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:58.394701 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] The token cache is being invalidate because project 2d7166cb05e745408ceb6df34a5ac548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:58.395016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:58.395642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-2de10745-d46a-461f-88ec-56f2f6703b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:58.397117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1297/2603] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:58 2022] DELETE /identity/v3/projects/2d7166cb05e745408ceb6df34a5ac548 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:58.402751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.403249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.403351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.422823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:58.424020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.481502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1307/2604] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:58.490250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.490538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.490812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.510418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:58.511605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.519432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1298/2605] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:58.523479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.534444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e937ed-3caa-4b07-8b1f-2bbd0b781f6a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.539205 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.539899 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.540178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.540444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.541172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:58.541458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.543063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.554679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1308/2606] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:06:58.558866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.568202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb151fd8-2ea6-4148-b544-cc7f6287d590 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.573496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.574089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.574369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.574642 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.575297 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.577234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.604429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1299/2607] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:58 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:58.608547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.618443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955bc0-2377-4320-8392-d84861a482a9 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.674356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.674987 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.675268 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.675539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.676188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.678144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.699360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1309/2608] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:58 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:58.703387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.713696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e8fa-d24c-45cf-b4e7-97a1453a7ebe admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.718395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.718989 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.719276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.719548 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.720180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.721804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.732225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1300/2609] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:58.735775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.746186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce517d1-77a5-4ec8-8724-f66e9a0baf0d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.750878 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fee7e-234a-418a-a29f-65e3df360315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.751464 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fee7e-234a-418a-a29f-65e3df360315 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.751746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fee7e-234a-418a-a29f-65e3df360315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.752022 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fee7e-234a-418a-a29f-65e3df360315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.752683 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fee7e-234a-418a-a29f-65e3df360315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.754422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fee7e-234a-418a-a29f-65e3df360315 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.764826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1310/2610] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:58.768626 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.774898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:58.779276 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e072a7-ea1f-4244-a9dd-99e87b3ef826 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.785118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.786033 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.786469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.786920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] PATH_INFO: `/v3/projects/1e9d5fe3da40410ea2715e0ef203ac22/users/d57e02496c73484ead7a73de5943bc4d/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.802229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9d5fe3da40410ea2715e0ef203ac22, user_id=d57e02496c73484ead7a73de5943bc4d, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.804885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.818804 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1301/2611] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:58 2022] PUT /identity/v3/projects/1e9d5fe3da40410ea2715e0ef203ac22/users/d57e02496c73484ead7a73de5943bc4d/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:58.828951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.829239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.829586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.856927 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] MFA Rules not processed for user `d57e02496c73484ead7a73de5943bc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:58.858185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.875158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:58.923336 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1311/2612] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:06:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:58.934542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.936217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.991660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93ebb-647d-4c1b-9193-6c75fbd8802e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.995883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a7241-1cba-4270-8f71-69b6b07d6143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.996483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7241-1cba-4270-8f71-69b6b07d6143 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.996766 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7241-1cba-4270-8f71-69b6b07d6143 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.997042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7241-1cba-4270-8f71-69b6b07d6143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:59.005425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a7241-1cba-4270-8f71-69b6b07d6143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:59.006880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a7241-1cba-4270-8f71-69b6b07d6143 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:59.016035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1302/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:08.920437 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=19 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:08.921806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:08.983172 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a5718-2099-41f1-acbd-ca252be474b2 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:08.987843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:08.988487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:08.988766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:08.989038 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] PATH_INFO: `/v3/users/d57e02496c73484ead7a73de5943bc4d` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:08.990186 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57e02496c73484ead7a73de5943bc4d)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:08.992163 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:09.012136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:09.036675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57e02496c73484ead7a73de5943bc4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.037329 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57e02496c73484ead7a73de5943bc4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.045086 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57e02496c73484ead7a73de5943bc4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.058827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57e02496c73484ead7a73de5943bc4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.067675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57e02496c73484ead7a73de5943bc4d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.074260 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1312/2614] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:08 2022] DELETE /identity/v3/users/d57e02496c73484ead7a73de5943bc4d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:09.079126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:09.079411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:09.079685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:09.099610 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:09.100846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:09.163119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1303/2615] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:09.173077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:09.174592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:09.231519 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848eb98-1d43-411a-94c1-2feee8d8fac5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:09.235219 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:09.235826 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:09.236106 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:09.236381 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:09.245881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:09.247306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:09.256633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1313/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:09.517159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:09.518658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:09.531250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730feac-7a08-4c7a-8035-df1da65866b7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:09.536951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:09.537624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:09.537994 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:09.538373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] PATH_INFO: `/v3/projects/1e9d5fe3da40410ea2715e0ef203ac22` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:09.539621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9d5fe3da40410ea2715e0ef203ac22)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:09.542852 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:09.590595 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9d5fe3da40410ea2715e0ef203ac22', 'request_id': 'req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.596653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9d5fe3da40410ea2715e0ef203ac22', 'request_id': 'req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.603820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9d5fe3da40410ea2715e0ef203ac22', 'request_id': 'req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.614381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] The token cache is being invalidate because project 1e9d5fe3da40410ea2715e0ef203ac22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:09.614670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.615322 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:09.616797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1304/2617] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:09 2022] DELETE /identity/v3/projects/1e9d5fe3da40410ea2715e0ef203ac22 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:19.261420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:19.611376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:24.617523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:24.618954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:24.630096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4611-ba45-471e-b363-08004dc243c6 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:24.677672 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:24.678265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:24.678544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:24.678815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:24.680491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:24.742194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:24.743631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:24.753307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1314/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:27.886559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:27.888013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:27.903024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc9da-0084-4b8d-a7e1-8d74e1e52abd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:27.907693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:27.908332 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:27.908612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:27.908884 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] PATH_INFO: `/v3/users/39d380ad69d9417a86f88f45341b68a7` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:27.910150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d380ad69d9417a86f88f45341b68a7)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:27.912052 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:27.967893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d380ad69d9417a86f88f45341b68a7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:27.976173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d380ad69d9417a86f88f45341b68a7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:27.976880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d380ad69d9417a86f88f45341b68a7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:27.994094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d380ad69d9417a86f88f45341b68a7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.001393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f2216ddd-dff8-49c9-bc59-12858b0609f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d380ad69d9417a86f88f45341b68a7'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.009441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1305/2619] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:27 2022] DELETE /identity/v3/users/39d380ad69d9417a86f88f45341b68a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:28.192066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.202094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d00dc-9ea6-46c8-86a7-70ae7d24399a service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.264259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.265223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.265535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.265806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] PATH_INFO: `/v3/projects/a1783437d8ee40e6bb1d95fbabb185d9` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.266931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1783437d8ee40e6bb1d95fbabb185d9)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.268848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.327169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1783437d8ee40e6bb1d95fbabb185d9', 'request_id': 'req-a233bffd-4c93-44e6-9b59-2276e0320c85'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.329817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:28.334982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1783437d8ee40e6bb1d95fbabb185d9', 'request_id': 'req-a233bffd-4c93-44e6-9b59-2276e0320c85'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.345850 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1783437d8ee40e6bb1d95fbabb185d9', 'request_id': 'req-a233bffd-4c93-44e6-9b59-2276e0320c85'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.357021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] The token cache is being invalidate because project a1783437d8ee40e6bb1d95fbabb185d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:28.357338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.357988 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a233bffd-4c93-44e6-9b59-2276e0320c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:28.359774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1315/2620] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:28 2022] DELETE /identity/v3/projects/a1783437d8ee40e6bb1d95fbabb185d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:28.364339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.364629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.364906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.386486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:28.387768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:28.455939 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1306/2621] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:28.464573 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.464858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.465195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.486166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:28.487421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:28.496125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1316/2622] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:28.500378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.511866 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe971c9-a2ea-4e6c-86ac-1830f47e1c7a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.516602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.517296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.517670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.518013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.518723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:28.519093 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.520759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.532747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1307/2623] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:07:28.537194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.546911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94c3f-771e-451e-9e41-b880433d6867 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.551842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.552445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.552731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.553032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.553705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.556201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.592505 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1317/2624] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:28 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:28.593814 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.604780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0032-8e06-43cd-aee0-1b022cd0c492 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.704128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.704918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.705204 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.705637 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.706436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.708512 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.718827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:28.737141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1308/2625] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:28 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:28.742395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.757607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2d07-56ef-44dd-a682-b51fc14cb4d5 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.763775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.764693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.764983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.765521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.766235 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.768063 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.780413 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1318/2626] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:28.784823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.801151 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf005b8-9f4b-40fb-9e64-504914b138d1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.812572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72cbc0-dee0-466f-902d-78847f3fe2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.813345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72cbc0-dee0-466f-902d-78847f3fe2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.813749 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72cbc0-dee0-466f-902d-78847f3fe2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.814080 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72cbc0-dee0-466f-902d-78847f3fe2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.815775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72cbc0-dee0-466f-902d-78847f3fe2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.817788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72cbc0-dee0-466f-902d-78847f3fe2e7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.835730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1309/2627] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:28.840289 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:28.854795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1068e-aa08-47c1-b05c-bac22f282d28 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:28.859568 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:28.860241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.860521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.860872 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] PATH_INFO: `/v3/projects/e3e33f4e33a446f69634520035826c2f/users/c300d3dd05aa410da3e68c801dc20dec/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.875833 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e33f4e33a446f69634520035826c2f, user_id=c300d3dd05aa410da3e68c801dc20dec, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:28.878513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:28.893694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1319/2628] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:28 2022] PUT /identity/v3/projects/e3e33f4e33a446f69634520035826c2f/users/c300d3dd05aa410da3e68c801dc20dec/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:28.904736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:28.905288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:28.905445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:28.933864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] MFA Rules not processed for user `c300d3dd05aa410da3e68c801dc20dec`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:28.935087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:29.001397 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1310/2629] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:29.003806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.070610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286faac-bf87-4e8a-9436-f12c799d0e2d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.075663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.076476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.076789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.077141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.077858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.080157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.116212 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1320/2630] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:29 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:29.117373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.133175 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd0c3-5dca-4be4-8ffe-18eff462d1ed None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.207546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.208292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.208641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.208981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.209715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.211744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.236087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1311/2631] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:29 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:29.240164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.250585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d94032-a725-4c9c-8e0c-8833cbf2ff46 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.255213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.255817 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.256097 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.256373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.257019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.259180 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.271734 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1321/2632] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:29.274302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.285078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61031-fa2d-407b-acdf-23a396fc5868 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.289959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.290621 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.290898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.291170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] PATH_INFO: `/v3/projects/06b63039d3114df7901d64e0fc969418/users/1e5e1bc1f8704fdea15876c66139bde4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.306658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b63039d3114df7901d64e0fc969418, user_id=1e5e1bc1f8704fdea15876c66139bde4, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.309333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.323325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1312/2633] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:29 2022] PUT /identity/v3/projects/06b63039d3114df7901d64e0fc969418/users/1e5e1bc1f8704fdea15876c66139bde4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:29.327304 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.337950 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f14447-9570-41d8-b939-4a79460a3eec admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.388178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:29.400662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e085a-fa63-4d1c-8cb2-b85f6689bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.401298 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e085a-fa63-4d1c-8cb2-b85f6689bcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.401583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e085a-fa63-4d1c-8cb2-b85f6689bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.402114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e085a-fa63-4d1c-8cb2-b85f6689bcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.402756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e085a-fa63-4d1c-8cb2-b85f6689bcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.404342 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e085a-fa63-4d1c-8cb2-b85f6689bcf7 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.418018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1322/2634] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:29.419186 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.429562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677673f-1caa-4851-9fe2-cc5aabb65104 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.434287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.434940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.435223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.435499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] PATH_INFO: `/v3/projects/06b63039d3114df7901d64e0fc969418/users/1e5e1bc1f8704fdea15876c66139bde4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.437476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b63039d3114df7901d64e0fc969418, user_id=1e5e1bc1f8704fdea15876c66139bde4, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.440090 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.452315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1313/2635] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:29 2022] PUT /identity/v3/projects/06b63039d3114df7901d64e0fc969418/users/1e5e1bc1f8704fdea15876c66139bde4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:29.464352 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.464646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.464976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.501128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] MFA Rules not processed for user `1e5e1bc1f8704fdea15876c66139bde4`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:29.502419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:29.581491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1323/2636] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:29.593459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:29.595194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:29.619574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:29.660065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7b9ae-c1af-481c-b7eb-73aaa9a5c1bd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:29.668328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f75d-edbf-4ac5-89e7-4dcd4e166292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:29.669044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f75d-edbf-4ac5-89e7-4dcd4e166292 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:29.669307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f75d-edbf-4ac5-89e7-4dcd4e166292 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:29.669761 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f75d-edbf-4ac5-89e7-4dcd4e166292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:29.681936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802f75d-edbf-4ac5-89e7-4dcd4e166292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:29.685753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802f75d-edbf-4ac5-89e7-4dcd4e166292 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:29.705680 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1314/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:30.129127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:30.195865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc71e67-55a2-46c8-9a32-e8644b642cfa None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:30.200489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:30.201119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:30.201608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:30.201889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] PATH_INFO: `/v3/users/c300d3dd05aa410da3e68c801dc20dec` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:30.203009 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c300d3dd05aa410da3e68c801dc20dec)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:30.204919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:30.260829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c300d3dd05aa410da3e68c801dc20dec'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.261510 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c300d3dd05aa410da3e68c801dc20dec'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.268856 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c300d3dd05aa410da3e68c801dc20dec'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.282832 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c300d3dd05aa410da3e68c801dc20dec'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.285616 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:30.296296 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c300d3dd05aa410da3e68c801dc20dec'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.305006 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1324/2638] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:30 2022] DELETE /identity/v3/users/c300d3dd05aa410da3e68c801dc20dec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:30.311060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:30.311545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:30.311645 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:30.337473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:30.338815 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:30.400664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1315/2639] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:30.411094 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:30.412849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:30.472663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2a43-384c-4a76-97f3-80282420973a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:30.476456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:30.477065 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:30.477930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:30.478251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:30.487185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:30.488604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:30.498182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1325/2640] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:30.775281 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:30.777104 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:30.789425 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d72ce4-4a2d-4777-8235-ff3e4b81e53b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:30.794920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:30.795559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:30.795837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:30.796106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] PATH_INFO: `/v3/projects/e3e33f4e33a446f69634520035826c2f` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:30.798002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e33f4e33a446f69634520035826c2f)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:30.799945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:30.847069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e33f4e33a446f69634520035826c2f', 'request_id': 'req-75bf89a6-8061-4d78-8046-f82031974a4f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.853763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e33f4e33a446f69634520035826c2f', 'request_id': 'req-75bf89a6-8061-4d78-8046-f82031974a4f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.861073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e33f4e33a446f69634520035826c2f', 'request_id': 'req-75bf89a6-8061-4d78-8046-f82031974a4f'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.872078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] The token cache is being invalidate because project e3e33f4e33a446f69634520035826c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:30.872395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.873020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.874584 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1316/2641] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:30 2022] DELETE /identity/v3/projects/e3e33f4e33a446f69634520035826c2f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:30.878517 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:30.888016 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209353e-eb4c-47b3-a939-f75f508104f8 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:30.944299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:30.944918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:30.945194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:30.945494 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] PATH_INFO: `/v3/users/1e5e1bc1f8704fdea15876c66139bde4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:30.946609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5e1bc1f8704fdea15876c66139bde4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:30.948500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:30.992411 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5e1bc1f8704fdea15876c66139bde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:30.993615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5e1bc1f8704fdea15876c66139bde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.000563 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5e1bc1f8704fdea15876c66139bde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.012690 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5e1bc1f8704fdea15876c66139bde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.019561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c1168930-d5a3-4f38-9e4b-ca9030fa6d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5e1bc1f8704fdea15876c66139bde4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.025544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1326/2642] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:30 2022] DELETE /identity/v3/users/1e5e1bc1f8704fdea15876c66139bde4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:31.299907 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.301357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:31.314847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf89a6-8061-4d78-8046-f82031974a4f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.374931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:31.390480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.391288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.391741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.392198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] PATH_INFO: `/v3/projects/06b63039d3114df7901d64e0fc969418` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.393349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b63039d3114df7901d64e0fc969418)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.395243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.449638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b63039d3114df7901d64e0fc969418', 'request_id': 'req-8c8d3985-5987-4bc2-be00-d3b59c26c731'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.456855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b63039d3114df7901d64e0fc969418', 'request_id': 'req-8c8d3985-5987-4bc2-be00-d3b59c26c731'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.466739 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b63039d3114df7901d64e0fc969418', 'request_id': 'req-8c8d3985-5987-4bc2-be00-d3b59c26c731'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.485514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] The token cache is being invalidate because project 06b63039d3114df7901d64e0fc969418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:31.485807 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.486462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8c8d3985-5987-4bc2-be00-d3b59c26c731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:31.487981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1317/2643] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:31 2022] DELETE /identity/v3/projects/06b63039d3114df7901d64e0fc969418 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:31.494222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.494716 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.494914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.516143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:31.517445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:31.526742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:31.579583 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1327/2644] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:31.588054 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.588342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.588618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.608296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:31.609532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:31.617707 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1318/2645] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:31.622252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.632245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761d3fb-eb0b-410d-9d4c-f723be3e6271 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.637400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.637997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.638310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.638588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.639233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:31.639536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.641315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.653294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1328/2646] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:07:31.657620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.667152 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf491ce-fc8c-406f-b50e-938a52e54f51 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.671785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.672373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.672650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.672921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.673664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.677904 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.702897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1319/2647] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:31 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:31.707108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.718409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251db13-cc3e-4a37-bdb1-0b9f5714f892 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.775570 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.776396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.776682 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.777276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.777925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.779963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.799849 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1329/2648] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:31 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:31.804283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.814493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bffc11-0c2e-4cd6-b307-3517903803b6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.819117 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.819706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.819981 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.820250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.820906 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.822975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.832676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1320/2649] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:31.837251 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.847145 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5d167-06e0-4e55-995e-8e04a77fd78a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.852137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c8f7-93c2-4a2f-bac1-98bdb3c407e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.852740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8f7-93c2-4a2f-bac1-98bdb3c407e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.853018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8f7-93c2-4a2f-bac1-98bdb3c407e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.853319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8f7-93c2-4a2f-bac1-98bdb3c407e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.853962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c8f7-93c2-4a2f-bac1-98bdb3c407e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.855580 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c8f7-93c2-4a2f-bac1-98bdb3c407e6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.866116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1330/2650] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:31.870646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:31.880572 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add70e-cbba-4498-a216-5c45d4306dd2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:31.885794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:31.886382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.886668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.886938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] PATH_INFO: `/v3/projects/63a6880fdf27439db25533b23d6442ab/users/b08768c699fe48e6ae912505fd81e7f4/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.902990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a6880fdf27439db25533b23d6442ab, user_id=b08768c699fe48e6ae912505fd81e7f4, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:31.905633 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:31.918711 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1321/2651] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:31 2022] PUT /identity/v3/projects/63a6880fdf27439db25533b23d6442ab/users/b08768c699fe48e6ae912505fd81e7f4/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:31.928962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:31.929250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:31.929612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:31.957119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] MFA Rules not processed for user `b08768c699fe48e6ae912505fd81e7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:31.958356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:32.021702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1331/2652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:32.026187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.086340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcc99-cc27-4773-a1b3-b68fefdcc8d1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.091377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.091973 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.092251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.092544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.093146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.095051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.114686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:32.123006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1322/2653] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:32 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:32.126727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.137861 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ead2d9-d687-463f-9247-6107fef0719a None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.142427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:32.196731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.197373 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.197654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.197920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.198542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.200432 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.221385 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1332/2654] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:32 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:32.225373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.235366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6c80-dfd0-4632-9791-f0239b505238 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.239988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.240574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.240874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.241144 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.241806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.243401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.254163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1323/2655] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:32.258091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.268374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1af0a-8440-4acc-882c-6b9213664f1d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.272933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.273614 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.273895 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.274216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] PATH_INFO: `/v3/projects/06781bfe363f4150a6b9862918472ead/users/6126f4d9e64a47fea13e7789d2dd507a/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.289248 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06781bfe363f4150a6b9862918472ead, user_id=6126f4d9e64a47fea13e7789d2dd507a, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.291892 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.304904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1333/2656] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:32 2022] PUT /identity/v3/projects/06781bfe363f4150a6b9862918472ead/users/6126f4d9e64a47fea13e7789d2dd507a/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:32.308825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.318871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97547-e337-4153-bdf6-a57c34370262 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.375575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d25ec-b252-4999-8c12-0db0dd86fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.376182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d25ec-b252-4999-8c12-0db0dd86fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.376464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d25ec-b252-4999-8c12-0db0dd86fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.376736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d25ec-b252-4999-8c12-0db0dd86fd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.377466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d25ec-b252-4999-8c12-0db0dd86fd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.379050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d25ec-b252-4999-8c12-0db0dd86fd0c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.389099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1324/2657] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:32.393249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.404087 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ae3ea-10b7-48b0-99e5-1ae04b2c0383 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.408668 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.409360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.409645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.409923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] PATH_INFO: `/v3/projects/06781bfe363f4150a6b9862918472ead/users/6126f4d9e64a47fea13e7789d2dd507a/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.411840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06781bfe363f4150a6b9862918472ead, user_id=6126f4d9e64a47fea13e7789d2dd507a, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.414507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.424387 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1334/2658] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:32 2022] PUT /identity/v3/projects/06781bfe363f4150a6b9862918472ead/users/6126f4d9e64a47fea13e7789d2dd507a/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:32.435582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.435865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.436140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.463658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] MFA Rules not processed for user `6126f4d9e64a47fea13e7789d2dd507a`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:32.464843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:32.531745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1325/2659] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:32.543292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.544582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:32.609400 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c0687-4ec7-4c2f-a277-9d7d11dace58 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.615059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.615059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.615059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.615059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.624673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:32.624926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.626095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:32.626404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.635985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1335/2660] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:32.686936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ca31-4167-427e-b05b-977fc468b14d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:32.690691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:32.691292 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:32.691575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:32.691849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:32.693618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:32.719573 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:32.763059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:32.764513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894df5d-83d4-4b2a-b7e8-2d540a18f907 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:32.775935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1326/2661] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:07:34.033632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:34.046041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e2f79-48c3-48e5-b307-247d3047735c service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:34.050606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:34.051233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:34.051507 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:34.051822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] PATH_INFO: `/v3/users/b08768c699fe48e6ae912505fd81e7f4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:34.052910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08768c699fe48e6ae912505fd81e7f4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:34.054870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:34.103090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08768c699fe48e6ae912505fd81e7f4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.103792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08768c699fe48e6ae912505fd81e7f4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.111755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08768c699fe48e6ae912505fd81e7f4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.117158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:34.128303 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08768c699fe48e6ae912505fd81e7f4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.135891 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08768c699fe48e6ae912505fd81e7f4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.142185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1336/2662] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:34 2022] DELETE /identity/v3/users/b08768c699fe48e6ae912505fd81e7f4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:34.146941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:34.147486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:34.147486 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:34.168649 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:34.169991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:34.232404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1327/2663] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:34.242545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:34.244020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:34.304655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d20729-9406-4836-a52a-b8c9f6539738 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:34.308320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:34.308925 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:34.309201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:34.309501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:34.318973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:34.320401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:34.330605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1337/2664] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:34.633047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:34.635242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:34.653076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7d75-cbef-49a1-9b66-afc399420fe8 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:34.658035 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:34.658748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:34.659143 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:34.659503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] PATH_INFO: `/v3/projects/63a6880fdf27439db25533b23d6442ab` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:34.660731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a6880fdf27439db25533b23d6442ab)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:34.662790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:34.728171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a6880fdf27439db25533b23d6442ab', 'request_id': 'req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.735185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a6880fdf27439db25533b23d6442ab', 'request_id': 'req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.743565 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a6880fdf27439db25533b23d6442ab', 'request_id': 'req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.756753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] The token cache is being invalidate because project 63a6880fdf27439db25533b23d6442ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:34.757139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.757892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.760339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1328/2665] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:34 2022] DELETE /identity/v3/projects/63a6880fdf27439db25533b23d6442ab => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:34.764195 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:34.774396 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cff4b-4d8e-49f5-96f3-9d1a5f6b8d2e service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:34.840968 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:34.841804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:34.842192 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:34.842589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] PATH_INFO: `/v3/users/6126f4d9e64a47fea13e7789d2dd507a` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:34.843911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6126f4d9e64a47fea13e7789d2dd507a)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:34.846261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:34.903339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6126f4d9e64a47fea13e7789d2dd507a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.904176 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6126f4d9e64a47fea13e7789d2dd507a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.912202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6126f4d9e64a47fea13e7789d2dd507a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.927337 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6126f4d9e64a47fea13e7789d2dd507a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.937954 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-b7aff430-c0c8-4817-ad19-d53a64570b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6126f4d9e64a47fea13e7789d2dd507a'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:34.939902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:34.948310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1338/2666] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:34 2022] DELETE /identity/v3/users/6126f4d9e64a47fea13e7789d2dd507a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:35.367497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:35.369602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:35.382889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2e4b3-21fa-4d31-9fef-b4081cf19250 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:35.428793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:35.451679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:35.452329 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.452614 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.452885 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] PATH_INFO: `/v3/projects/06781bfe363f4150a6b9862918472ead` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.454023 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=06781bfe363f4150a6b9862918472ead)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:35.455915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:35.502427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06781bfe363f4150a6b9862918472ead', 'request_id': 'req-773ec8ac-4574-407a-913e-5747733949ba'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:35.508756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06781bfe363f4150a6b9862918472ead', 'request_id': 'req-773ec8ac-4574-407a-913e-5747733949ba'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:35.518289 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06781bfe363f4150a6b9862918472ead', 'request_id': 'req-773ec8ac-4574-407a-913e-5747733949ba'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:35.531938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] The token cache is being invalidate because project 06781bfe363f4150a6b9862918472ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:35.532337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:35.533120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-773ec8ac-4574-407a-913e-5747733949ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:35.534668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1329/2667] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:35 2022] DELETE /identity/v3/projects/06781bfe363f4150a6b9862918472ead => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:35.540705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.541203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.541318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.561026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:35.562241 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:35.645822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1339/2668] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:35.647493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.647779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.648055 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.675786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:35.677217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:35.686788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1330/2669] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:35.690733 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:35.705292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024a4d-453c-441f-9445-540c575515e2 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:35.714167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:35.714825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.715109 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.715382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.716036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:35.716345 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:35.718019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:35.731560 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1340/2670] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:07:35.735746 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:35.747522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59594b2-604e-4f5a-8fc0-73e8f57383d0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:35.753851 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:35.754465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.754743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.755010 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.755641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:35.757559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:35.800521 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1331/2671] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:35 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:35.804506 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:35.816645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc94e1-94ea-47d6-8e3d-b62153e512b8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:35.889159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:35.889946 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.890447 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.890588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.891354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:35.893292 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:35.922456 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1341/2672] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:35 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:35.926602 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:35.950623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd663b3-1ae2-43cb-a96e-7d7e63a22478 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:35.955909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:35.956528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:35.956811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:35.957081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:35.957854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:35.959357 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:35.973441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1332/2673] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:35.976213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:35.988479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf34b-a213-4a60-a653-67c34a3913fd admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.012670 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adab6-7663-4b16-a6ee-c0903021f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.013787 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adab6-7663-4b16-a6ee-c0903021f18c admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.014168 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adab6-7663-4b16-a6ee-c0903021f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.014548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adab6-7663-4b16-a6ee-c0903021f18c admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.015357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6adab6-7663-4b16-a6ee-c0903021f18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.017739 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6adab6-7663-4b16-a6ee-c0903021f18c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.036335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1342/2674] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:36.041140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.054280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7d873-8447-40e2-8bef-bff71112d537 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.063753 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.064440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.064723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.065003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] PATH_INFO: `/v3/projects/dd602c83aa934c36aaa23b0284e7965c/users/f33688a0562a4b18af1416db42b8debc/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.090013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd602c83aa934c36aaa23b0284e7965c, user_id=f33688a0562a4b18af1416db42b8debc, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.092961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.135453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1333/2675] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:36 2022] PUT /identity/v3/projects/dd602c83aa934c36aaa23b0284e7965c/users/f33688a0562a4b18af1416db42b8debc/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:36.136324 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.136618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.136898 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.178311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] MFA Rules not processed for user `f33688a0562a4b18af1416db42b8debc`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:36.179552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.225873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.228450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.244408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:36.257536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1343/2676] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:07:36.261469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.306320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510e6b-7202-468d-b90b-19c1ffa002e2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.311263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.311972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.312325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.312699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] PATH_INFO: `/v3/users/412a8703f2d44e95ab52d655316404bd` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.314999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:36.326050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881bd7-a306-4e7e-8590-9b5d5667b71c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.329193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412a8703f2d44e95ab52d655316404bd)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.330718 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.331330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.331451 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.331637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.331884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.332572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.334491 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.365320 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1344/2677] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:36.369035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.384261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412a8703f2d44e95ab52d655316404bd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.392105 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412a8703f2d44e95ab52d655316404bd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.392889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412a8703f2d44e95ab52d655316404bd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.406433 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412a8703f2d44e95ab52d655316404bd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.413750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412a8703f2d44e95ab52d655316404bd'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.419936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1334/2678] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:36 2022] DELETE /identity/v3/users/412a8703f2d44e95ab52d655316404bd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:36.442524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fc57-b97e-4210-bdd2-d91c80e2ed06 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.500679 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.501359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.501644 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.501919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.502549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.504492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.527587 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1345/2679] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:36.531723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.533307 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.546740 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db214018-5e03-4c0d-b570-57c6677abef2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.551598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.552199 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.552483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.552759 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.553481 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.555097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.566435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1335/2680] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:36.570520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.582725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1947cc5-c484-44cd-a1c5-b25021cc7386 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.588341 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.589083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.589458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.589759 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] PATH_INFO: `/v3/projects/250da98abf30492785962e8e0eb1fe82/users/a7e8a4085b584c85b9e7aa73b3d18d46/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.598441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.600603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.604356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:36.608945 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250da98abf30492785962e8e0eb1fe82, user_id=a7e8a4085b584c85b9e7aa73b3d18d46, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.611951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.616859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e174e-b828-4058-abca-5e11c405b22f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.622874 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.623671 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.623982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.624387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] PATH_INFO: `/v3/projects/31a9faee867742ae99bc4938ab03b236` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.627998 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1346/2681] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:36 2022] PUT /identity/v3/projects/250da98abf30492785962e8e0eb1fe82/users/a7e8a4085b584c85b9e7aa73b3d18d46/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:36.631933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.644930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a9faee867742ae99bc4938ab03b236)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.646715 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.694365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1222-3c86-40e7-87b2-b037306f0e29 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.695021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a9faee867742ae99bc4938ab03b236', 'request_id': 'req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.702495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a9faee867742ae99bc4938ab03b236', 'request_id': 'req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.710592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a9faee867742ae99bc4938ab03b236', 'request_id': 'req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.722181 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] The token cache is being invalidate because project 31a9faee867742ae99bc4938ab03b236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:36.722583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.723337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-1ad58a9c-3f48-4b35-9285-d5c076f0e4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:36.724937 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1336/2682] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:36 2022] DELETE /identity/v3/projects/31a9faee867742ae99bc4938ab03b236 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:36.729648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2b51-8b1d-4546-8989-ef4187f514c8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.730374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2b51-8b1d-4546-8989-ef4187f514c8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.730870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2b51-8b1d-4546-8989-ef4187f514c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.768586 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-631d2b51-8b1d-4546-8989-ef4187f514c8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:36.770424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-631d2b51-8b1d-4546-8989-ef4187f514c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.778726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.779693 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.780164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.780604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.781708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.783889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1337/2683] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:07:36.784326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.791390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.791675 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.791948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.795137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1347/2684] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:36.799048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.800868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.812302 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:36.812815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ae68d-5a52-434f-93bd-37408735d47e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.813501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.817443 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743543-00a8-4ec9-90ee-07e2994ea033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.818021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743543-00a8-4ec9-90ee-07e2994ea033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.818300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743543-00a8-4ec9-90ee-07e2994ea033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.818569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743543-00a8-4ec9-90ee-07e2994ea033 admin admin] PATH_INFO: `/v3/projects/250da98abf30492785962e8e0eb1fe82/users/a7e8a4085b584c85b9e7aa73b3d18d46/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.820713 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743543-00a8-4ec9-90ee-07e2994ea033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250da98abf30492785962e8e0eb1fe82, user_id=a7e8a4085b584c85b9e7aa73b3d18d46, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.821905 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1338/2685] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:07:36.825919 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.826886 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743543-00a8-4ec9-90ee-07e2994ea033 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.837067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a74ee4-d186-4272-9ab3-a7d5ed1d158d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.839280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1348/2686] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:36 2022] PUT /identity/v3/projects/250da98abf30492785962e8e0eb1fe82/users/a7e8a4085b584c85b9e7aa73b3d18d46/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:36.850476 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.850756 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.851026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.855673 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:36.878923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] MFA Rules not processed for user `a7e8a4085b584c85b9e7aa73b3d18d46`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:36.880211 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.907303 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.907940 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.908219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.908543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.909219 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:36.909551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.911134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.926053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1339/2687] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:07:36.927114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.936779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81518329-c265-4fee-9e23-b8dabf8b097e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:36.941506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:36.942202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:36.942482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:36.942784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:36.943391 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:36.945294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:36.952173 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1349/2688] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:07:36.963597 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:36.964963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:36.973897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1340/2689] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:36.974574 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:36.978034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.024029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d835869-589e-4f93-9fa0-b261626239a0 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.040574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d16805-df09-4e01-9f58-759594ccf602 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.045232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.045860 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.046138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.046410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.047046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.048966 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.073372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1341/2690] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:36 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:37.073592 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.073978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.074278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.074558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.075215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.076322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:37.084677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8e19-4faa-4144-ab95-3d9a800ce88a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.089377 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.089959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.090238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.090510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.091136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.092702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.102536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1342/2691] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:37.106389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.115786 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac416-f6d6-4f54-b942-b20189f4a849 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.121092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.121693 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.121977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.122254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.122883 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.124546 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.135046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1343/2692] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:37.137203 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.138757 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea8c1-8a71-46ae-b6a3-ddc9e716f536 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.139159 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.147828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1350/2693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:37.148792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580aa2-fa89-4e5d-8eb5-7008f66e0ee5 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.154279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.154922 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.155233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.155525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] PATH_INFO: `/v3/projects/3086fe8b4a91443a896f158a54e2eb8d/users/f89fb863e05943e79c555aaa36a43b0b/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.170251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3086fe8b4a91443a896f158a54e2eb8d, user_id=f89fb863e05943e79c555aaa36a43b0b, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.172889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.186735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1344/2694] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:37 2022] PUT /identity/v3/projects/3086fe8b4a91443a896f158a54e2eb8d/users/f89fb863e05943e79c555aaa36a43b0b/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:37.198426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.198708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.198981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.227814 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] MFA Rules not processed for user `f89fb863e05943e79c555aaa36a43b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:37.229020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:37.297727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1351/2695] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:37.302401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.342484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:37.372949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9a06-15f7-4c40-9b14-2a6f247a778c admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.378318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.378911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.379195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.379475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.380095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.382061 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.412540 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1345/2696] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:37 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:37.417459 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.428676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f869c-02b1-47f8-81dc-58d35cf66db1 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.434591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:37.495674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.496384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.496665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.496930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.497633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.499635 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.524559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1352/2697] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:37 2022] POST /identity/v3/users => generated 307 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:37.526288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.536921 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796b286-ea5f-4a45-8096-b8786b8c750e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.541854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.542464 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.542747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.543020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.543656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.545243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.555769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1346/2698] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:37.559819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.569707 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11015f-2037-4130-9a83-3dc7f9b67e33 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.574834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.575482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.575761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.576039 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] PATH_INFO: `/v3/projects/8a71049c24f24868ac0ddb2b6872f963/users/aaa52fbb35584ae6ab4260caae4c2d93/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.593050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a71049c24f24868ac0ddb2b6872f963, user_id=aaa52fbb35584ae6ab4260caae4c2d93, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.595647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.608795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1353/2699] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:37 2022] PUT /identity/v3/projects/8a71049c24f24868ac0ddb2b6872f963/users/aaa52fbb35584ae6ab4260caae4c2d93/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:37.612784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.623189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e8ea0-cb42-4e65-b8ca-358b111e8781 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.679197 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0bcba-0156-4ffa-bbf4-76551c2ddd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.679796 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0bcba-0156-4ffa-bbf4-76551c2ddd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.680073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0bcba-0156-4ffa-bbf4-76551c2ddd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.680343 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0bcba-0156-4ffa-bbf4-76551c2ddd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.680972 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0bcba-0156-4ffa-bbf4-76551c2ddd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.682577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0bcba-0156-4ffa-bbf4-76551c2ddd64 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.692064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1347/2700] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:37.696797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.706914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6fb9-4315-44c9-9d4b-1004d0d6da47 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.712046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.712702 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.712981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.713252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] PATH_INFO: `/v3/projects/8a71049c24f24868ac0ddb2b6872f963/users/aaa52fbb35584ae6ab4260caae4c2d93/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.715174 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a71049c24f24868ac0ddb2b6872f963, user_id=aaa52fbb35584ae6ab4260caae4c2d93, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.717834 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.727569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1354/2701] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:37 2022] PUT /identity/v3/projects/8a71049c24f24868ac0ddb2b6872f963/users/aaa52fbb35584ae6ab4260caae4c2d93/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:37.738925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.739210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.739491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.767514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] MFA Rules not processed for user `aaa52fbb35584ae6ab4260caae4c2d93`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:37.768714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:37.833593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1348/2702] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:37.845331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:37.901589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69088-2465-4736-aaca-1f3ec9234b99 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:37.905523 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:37.906122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:37.906403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:37.906671 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:37.915485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:37.916906 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:37.926281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1355/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:38.003042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:38.013206 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88866a-ba7a-4271-b87a-03558da5e9cf None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:38.016928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:38.017647 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:38.017838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:38.018108 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:38.045296 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:38.076702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:38.078163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:38.086930 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1349/2704] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:39.732791 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:39.742062 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a470-1661-4f44-908d-3695e716dd3a service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:39.746637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8ef9b-1bb7-4ced-9e31-d8e112d16c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:39.747269 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8ef9b-1bb7-4ced-9e31-d8e112d16c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:39.747559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8ef9b-1bb7-4ced-9e31-d8e112d16c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:39.747822 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8ef9b-1bb7-4ced-9e31-d8e112d16c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:39.805778 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:39.808206 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8ef9b-1bb7-4ced-9e31-d8e112d16c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:39.810057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8ef9b-1bb7-4ced-9e31-d8e112d16c84 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:39.820561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1356/2705] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:42.119110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.180180 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ceb06-f7fc-43b2-8872-2bca5422bcc0 service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.184656 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.185318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.185599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.185870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] PATH_INFO: `/v3/users/f89fb863e05943e79c555aaa36a43b0b` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.186970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89fb863e05943e79c555aaa36a43b0b)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.188881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.234249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89fb863e05943e79c555aaa36a43b0b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.241369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89fb863e05943e79c555aaa36a43b0b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.242042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89fb863e05943e79c555aaa36a43b0b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.253772 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89fb863e05943e79c555aaa36a43b0b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.260947 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89fb863e05943e79c555aaa36a43b0b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.266736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1350/2706] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:42 2022] DELETE /identity/v3/users/f89fb863e05943e79c555aaa36a43b0b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:42.271265 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.271761 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.271869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.291559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:42.292749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:42.351160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1357/2707] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:07:42.360599 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.362185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:42.417544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:42.425434 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723c19-d769-46f2-a6d8-96598d35b717 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.430525 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.431077 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.431364 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.431631 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.441036 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.442494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.453230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1351/2708] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:42.740805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.742318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:42.757696 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2fd1e-fe74-4106-b0a3-3d96894dc916 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.762409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.763045 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.763322 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.763652 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] PATH_INFO: `/v3/projects/3086fe8b4a91443a896f158a54e2eb8d` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.764818 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3086fe8b4a91443a896f158a54e2eb8d)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.766808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.813808 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3086fe8b4a91443a896f158a54e2eb8d', 'request_id': 'req-e425ac6d-7442-4dd4-b77d-4765f8bb87db'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.819870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3086fe8b4a91443a896f158a54e2eb8d', 'request_id': 'req-e425ac6d-7442-4dd4-b77d-4765f8bb87db'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.827010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3086fe8b4a91443a896f158a54e2eb8d', 'request_id': 'req-e425ac6d-7442-4dd4-b77d-4765f8bb87db'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.837020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] The token cache is being invalidate because project 3086fe8b4a91443a896f158a54e2eb8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:42.837332 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.837942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.839383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1358/2709] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:42 2022] DELETE /identity/v3/projects/3086fe8b4a91443a896f158a54e2eb8d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:42.843643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.853730 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ad75-c6fd-4f57-8bcb-eb56b42da001 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.910816 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.911442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.911725 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.911998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] PATH_INFO: `/v3/users/aaa52fbb35584ae6ab4260caae4c2d93` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.913103 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa52fbb35584ae6ab4260caae4c2d93)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.915564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.960813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa52fbb35584ae6ab4260caae4c2d93'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.968333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa52fbb35584ae6ab4260caae4c2d93'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.969065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa52fbb35584ae6ab4260caae4c2d93'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.981420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa52fbb35584ae6ab4260caae4c2d93'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.988195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-0930e4ac-94e2-4d5b-b376-fef4ecc2aeac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa52fbb35584ae6ab4260caae4c2d93'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.994624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1352/2710] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:42 2022] DELETE /identity/v3/users/aaa52fbb35584ae6ab4260caae4c2d93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:43.280343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.281881 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:43.296958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ac6d-7442-4dd4-b77d-4765f8bb87db admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.370661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.371307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.371588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.371862 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] PATH_INFO: `/v3/projects/8a71049c24f24868ac0ddb2b6872f963` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.373100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a71049c24f24868ac0ddb2b6872f963)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.375066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.398359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:43.422754 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a71049c24f24868ac0ddb2b6872f963', 'request_id': 'req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:43.428823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a71049c24f24868ac0ddb2b6872f963', 'request_id': 'req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:43.436738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a71049c24f24868ac0ddb2b6872f963', 'request_id': 'req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:43.447565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] The token cache is being invalidate because project 8a71049c24f24868ac0ddb2b6872f963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:43.447852 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:43.448465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-83ef0519-5dad-4a88-a8dd-11bdfb804c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:43.449983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1359/2711] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:43 2022] DELETE /identity/v3/projects/8a71049c24f24868ac0ddb2b6872f963 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:43.454844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.455308 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.455411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.478780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:43.479961 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:43.553198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1353/2712] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:43.561326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.561615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.561938 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.583007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:43.584191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:43.592606 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1360/2713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:43.596938 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.607065 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf766e-f583-4074-91c6-454940536a64 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.612501 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.613100 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.613429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.613841 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.614652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:43.614960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.617041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.619702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:43.631508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1354/2714] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:07:43.638586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.647909 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810a95-07ce-4838-b5d5-f38c94f52930 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.653536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.654138 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.654416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.654689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.655307 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.657178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.686108 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1361/2715] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:43 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:43.690128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.701174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828b400-2c60-49e9-b7da-667f8b9f3df4 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.763043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.763691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.764006 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.764284 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.764909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.766920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.789168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1355/2716] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:43 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:43.793473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.806099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660b71-6064-4ea9-9058-f490f581e63a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.811928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.812564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.812885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.813869 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.814540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.816235 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.832745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1362/2717] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:43.834387 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.845470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3cc74-d570-42ab-84e5-13d2d8b9fc4e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.850839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2a9d-b507-4204-81e0-0b75031e0cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.851441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2a9d-b507-4204-81e0-0b75031e0cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.851758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2a9d-b507-4204-81e0-0b75031e0cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.852022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2a9d-b507-4204-81e0-0b75031e0cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.852660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a2a9d-b507-4204-81e0-0b75031e0cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.854309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a2a9d-b507-4204-81e0-0b75031e0cbe admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.865025 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1356/2718] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:43.869750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.879633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de1b7-4669-4f25-9b2c-962c42193c75 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.884662 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.885330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.885611 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.885879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] PATH_INFO: `/v3/projects/eae15cc36d5e4d2295eb694042c547cd/users/32bd216e99f94bb9a6a1bb7097bd5636/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.902084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae15cc36d5e4d2295eb694042c547cd, user_id=32bd216e99f94bb9a6a1bb7097bd5636, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.904719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.917127 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1363/2719] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:43 2022] PUT /identity/v3/projects/eae15cc36d5e4d2295eb694042c547cd/users/32bd216e99f94bb9a6a1bb7097bd5636/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:43.922076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cecc4-8527-44ac-93fa-d9a99723c815 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.922401 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cecc4-8527-44ac-93fa-d9a99723c815 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.922681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cecc4-8527-44ac-93fa-d9a99723c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.943318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-110cecc4-8527-44ac-93fa-d9a99723c815 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:43.944529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-110cecc4-8527-44ac-93fa-d9a99723c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:44.002373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1357/2720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:44.012544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:44.014253 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:44.070357 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045e7e-b6a5-4c80-8479-0e350124d83f admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:44.074724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:44.075301 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:44.075579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:44.075853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:44.084975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:44.086421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:44.096041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1364/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:44.706021 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:44.706494 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:44.706597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:44.735491 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] MFA Rules not processed for user `32bd216e99f94bb9a6a1bb7097bd5636`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:44.736748 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:44.803078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1358/2722] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:44.807610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:44.817466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e050c-9ab6-430d-8980-b5739ba10279 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:44.822100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:44.822700 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:44.822985 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:44.823261 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:44.823885 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:44.825864 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:44.856929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1365/2723] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:44 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:44.857980 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:44.866393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:44.876696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25d63b-fd0c-47d0-83a9-6f0c5eb5872b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:44.936459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:44.937271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:44.937619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:44.937949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:44.938638 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:44.940528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:44.962011 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1359/2724] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:44 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:44.965951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:44.976596 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf211dd-ee3a-481c-8d60-72712625a90d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:44.981816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:44.982426 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:44.982706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:44.982981 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:44.983617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:44.985194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:44.996475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1366/2725] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:45.000620 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:45.010735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466530-79f0-452a-9dc8-5828e54804e5 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:45.015538 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:45.016271 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:45.016561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:45.016836 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] PATH_INFO: `/v3/projects/6f8d02641d0e4707ac22333c2ee50c53/users/b3430280090b40a782b5fecc89f403c4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:45.035098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8d02641d0e4707ac22333c2ee50c53, user_id=b3430280090b40a782b5fecc89f403c4, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:45.038081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:45.052095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1360/2726] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:44 2022] PUT /identity/v3/projects/6f8d02641d0e4707ac22333c2ee50c53/users/b3430280090b40a782b5fecc89f403c4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:45.056266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:45.079542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13ea53-a4c9-4382-a558-d19be5637454 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:45.093725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:45.147042 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec04d8-681e-43c2-af30-b448c26d7213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:45.147735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec04d8-681e-43c2-af30-b448c26d7213 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:45.148012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec04d8-681e-43c2-af30-b448c26d7213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:45.148281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec04d8-681e-43c2-af30-b448c26d7213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:45.148977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec04d8-681e-43c2-af30-b448c26d7213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:45.150675 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec04d8-681e-43c2-af30-b448c26d7213 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:45.161125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1367/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:45.165910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:45.176794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97e16a-1930-4b46-bf7f-a5d42c7adab3 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:45.182131 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4ff20-b688-4eb7-87a1-c2dbdf5decd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:45.182783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4ff20-b688-4eb7-87a1-c2dbdf5decd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:45.183064 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4ff20-b688-4eb7-87a1-c2dbdf5decd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:45.183335 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4ff20-b688-4eb7-87a1-c2dbdf5decd4 admin admin] PATH_INFO: `/v3/projects/6f8d02641d0e4707ac22333c2ee50c53/users/b3430280090b40a782b5fecc89f403c4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:45.185233 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4ff20-b688-4eb7-87a1-c2dbdf5decd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8d02641d0e4707ac22333c2ee50c53, user_id=b3430280090b40a782b5fecc89f403c4, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:45.187892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4ff20-b688-4eb7-87a1-c2dbdf5decd4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:45.198833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1361/2728] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:45 2022] PUT /identity/v3/projects/6f8d02641d0e4707ac22333c2ee50c53/users/b3430280090b40a782b5fecc89f403c4/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:45.819460 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:45.819999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:45.819999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:45.848295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] MFA Rules not processed for user `b3430280090b40a782b5fecc89f403c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:45.849646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:45.924312 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1368/2729] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:45.935280 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:45.935863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:45.935863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:45.954849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] MFA Rules not processed for user `32bd216e99f94bb9a6a1bb7097bd5636`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:45.955988 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:46.013837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1362/2730] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:46.027482 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:46.028922 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:46.105470 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee041600-8bf7-4d67-bf0e-d60f61e45113 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:46.111100 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:46.111710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:46.111996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:46.112266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:46.120020 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:46.121703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:46.130428 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1369/2731] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:46.165274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:46.166735 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:46.224996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bcfc6-ca76-461a-ad01-3e8751d970aa None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:46.229936 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:46.230608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:46.230891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:46.231165 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:46.232949 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:46.247051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:46.248502 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:46.260000 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1363/2732] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:46.792090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:46.793667 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:46.825200 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:46.858813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc85d-f996-44f8-9d90-eb5e1a25e96b service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:46.862538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:46.863103 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:46.863384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:46.863659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:46.865603 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:46.879785 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:46.881308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33bbc7-de0d-44fd-b981-f0f13b8da5dd service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:46.892924 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1370/2733] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:07:52.406409 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:52.407918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:52.415045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:52.477817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f76a2c-2e2a-4ea0-bf8a-0d659b81706b service glance] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:52.482314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:52.482945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:52.483227 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:52.483497 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] PATH_INFO: `/v3/users/f33688a0562a4b18af1416db42b8debc` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:52.484624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33688a0562a4b18af1416db42b8debc)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:52.486556 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:52.534155 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33688a0562a4b18af1416db42b8debc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:52.542130 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33688a0562a4b18af1416db42b8debc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:52.542778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33688a0562a4b18af1416db42b8debc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:52.555768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33688a0562a4b18af1416db42b8debc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:52.562977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33688a0562a4b18af1416db42b8debc'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:52.569255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1364/2734] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:52 2022] DELETE /identity/v3/users/f33688a0562a4b18af1416db42b8debc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:52.574308 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:52.574792 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:52.574907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:52.594753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:52.595951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:52.665442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1371/2735] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:52.669005 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:52.670516 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:52.729771 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6628-fa40-4687-96a7-ad8e9dc19fe4 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:52.733395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:52.734004 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:52.734287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:52.734590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:52.743700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:52.745132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:52.754839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1365/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:53.022780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:53.024351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:53.042742 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf72df-680f-4ab3-80ae-44d19128ee21 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:53.047717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:53.048354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.048632 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.049132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] PATH_INFO: `/v3/projects/dd602c83aa934c36aaa23b0284e7965c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.050316 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd602c83aa934c36aaa23b0284e7965c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:53.052204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:53.099513 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd602c83aa934c36aaa23b0284e7965c', 'request_id': 'req-375b83fa-c989-4a8c-8a2f-d0fd86198dda'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.105605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd602c83aa934c36aaa23b0284e7965c', 'request_id': 'req-375b83fa-c989-4a8c-8a2f-d0fd86198dda'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.112765 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd602c83aa934c36aaa23b0284e7965c', 'request_id': 'req-375b83fa-c989-4a8c-8a2f-d0fd86198dda'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.123421 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] The token cache is being invalidate because project dd602c83aa934c36aaa23b0284e7965c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:53.123706 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.124321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.125827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1372/2737] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:53 2022] DELETE /identity/v3/projects/dd602c83aa934c36aaa23b0284e7965c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:53.129806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:53.140018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf9d9-5e2f-4ce7-a106-4704de5cb02d service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:53.163283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:53.199182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:53.199806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.200085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.200354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] PATH_INFO: `/v3/users/a7e8a4085b584c85b9e7aa73b3d18d46` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.201480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e8a4085b584c85b9e7aa73b3d18d46)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:53.203376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:53.247864 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e8a4085b584c85b9e7aa73b3d18d46'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.255850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e8a4085b584c85b9e7aa73b3d18d46'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.256473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e8a4085b584c85b9e7aa73b3d18d46'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.270569 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e8a4085b584c85b9e7aa73b3d18d46'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.278057 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6cc8eb76-1523-4441-bb48-77d9af802ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e8a4085b584c85b9e7aa73b3d18d46'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.283928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1366/2738] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:53 2022] DELETE /identity/v3/users/a7e8a4085b584c85b9e7aa73b3d18d46 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:53.558637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:53.560232 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:53.574300 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b83fa-c989-4a8c-8a2f-d0fd86198dda admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:53.620233 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:53.634473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:53.635118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.635429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.635705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] PATH_INFO: `/v3/projects/250da98abf30492785962e8e0eb1fe82` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.636858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=250da98abf30492785962e8e0eb1fe82)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:53.638795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:53.683816 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250da98abf30492785962e8e0eb1fe82', 'request_id': 'req-0fa22ecd-a6a2-4687-9088-4a3df31342fd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.689788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250da98abf30492785962e8e0eb1fe82', 'request_id': 'req-0fa22ecd-a6a2-4687-9088-4a3df31342fd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.697630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250da98abf30492785962e8e0eb1fe82', 'request_id': 'req-0fa22ecd-a6a2-4687-9088-4a3df31342fd'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.707865 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] The token cache is being invalidate because project 250da98abf30492785962e8e0eb1fe82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:53.708154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.708794 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-0fa22ecd-a6a2-4687-9088-4a3df31342fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:53.710353 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1373/2739] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:53 2022] DELETE /identity/v3/projects/250da98abf30492785962e8e0eb1fe82 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:53.715801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.716337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.716453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.735460 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:53.736686 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:53.794452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1367/2740] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:53.802015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.802299 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.802572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.822726 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:53.823919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:53.831984 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1374/2741] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:53.836085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:53.846026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fc3e6-e1ef-4176-8deb-22bdc44b36a7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:53.850628 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:53.851228 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.851509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.851788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.852436 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:53.852737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:53.855112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:53.873232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1368/2742] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:07:53.877533 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:53.887976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd2d-8500-415d-b226-5d0bff5dd7ec None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:53.893630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:53.894435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:53.895134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:53.895134 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:53.895907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:53.898057 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:53.932328 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1375/2743] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:53 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:53.933367 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:53.944545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc65f-7956-49f9-a16b-18338cfb4627 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:53.979578 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:54.011209 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.011827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.012110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.012385 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.013008 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.014957 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.036676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1369/2744] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:53 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:54.041544 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.051846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24521-5ced-456e-90ba-4dd8a87b304e admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.056920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.057547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.057827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.058096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.058758 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.060317 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.070783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1376/2745] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:54.074652 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.084745 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710787da-c4d4-4e0d-8647-98d3f69b95f1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.089520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0529e-c60c-44a5-9f7f-f0a9ffbfb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.090146 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0529e-c60c-44a5-9f7f-f0a9ffbfb8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.090428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0529e-c60c-44a5-9f7f-f0a9ffbfb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.090704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0529e-c60c-44a5-9f7f-f0a9ffbfb8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.091338 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0529e-c60c-44a5-9f7f-f0a9ffbfb8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.092925 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0529e-c60c-44a5-9f7f-f0a9ffbfb8b0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.103299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1370/2746] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:54.107231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.116983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece6cce-120f-4830-b4bb-bb698ebc3c46 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.122334 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.122977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.123259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.123539 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] PATH_INFO: `/v3/projects/a50f9014da1e40afa0b517c7a8122c12/users/b7cba97fbb9749d9b39aa133e7c53319/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.137591 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50f9014da1e40afa0b517c7a8122c12, user_id=b7cba97fbb9749d9b39aa133e7c53319, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.140202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.153490 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1377/2747] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:54 2022] PUT /identity/v3/projects/a50f9014da1e40afa0b517c7a8122c12/users/b7cba97fbb9749d9b39aa133e7c53319/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:54.165286 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.165574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.165845 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.193635 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] MFA Rules not processed for user `b7cba97fbb9749d9b39aa133e7c53319`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:54.194855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:54.259898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1371/2748] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:54.264393 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.324586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef95c-2ab5-4ade-9794-3b118da3872d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.329129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.329751 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.330034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.330309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.330915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.332806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.354326 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:54.361689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1378/2749] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:54 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:54.365694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.376213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbdbe6-98aa-4937-945f-653043ad09cb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.432691 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.433312 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.433594 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.433870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.434496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.436424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.456229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1372/2750] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:54 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:54.461218 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.471536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a693-7e53-4c65-af08-beb26ba964cf admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.476197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.477383 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.477665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.477939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.478572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.480159 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.490657 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1379/2751] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:54.494736 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.504454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377274-6d29-4b83-bbf6-c70969765daf admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.509043 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.509720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.509997 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.510267 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] PATH_INFO: `/v3/projects/db5b881503054c77b0b408245f38b841/users/3de5f2365e27479b8459536c08d4fd8f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.525407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5b881503054c77b0b408245f38b841, user_id=3de5f2365e27479b8459536c08d4fd8f, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.528393 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.541689 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1373/2752] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:54 2022] PUT /identity/v3/projects/db5b881503054c77b0b408245f38b841/users/3de5f2365e27479b8459536c08d4fd8f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:54.545694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.555649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0532427-df5b-4f7f-b636-39639624cb8b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.610457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fb1d4-c721-44ce-9a77-ebcabfab7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.611099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fb1d4-c721-44ce-9a77-ebcabfab7bda admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.611270 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fb1d4-c721-44ce-9a77-ebcabfab7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.611549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fb1d4-c721-44ce-9a77-ebcabfab7bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.612213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fb1d4-c721-44ce-9a77-ebcabfab7bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.613843 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fb1d4-c721-44ce-9a77-ebcabfab7bda admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.623540 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1380/2753] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:54.627629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.637871 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1099df-fa8d-4fb5-84d3-20da8a047476 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.642422 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.643059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.643336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.643606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] PATH_INFO: `/v3/projects/db5b881503054c77b0b408245f38b841/users/3de5f2365e27479b8459536c08d4fd8f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.645574 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5b881503054c77b0b408245f38b841, user_id=3de5f2365e27479b8459536c08d4fd8f, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.648136 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.650833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:54.660372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1374/2754] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:54 2022] PUT /identity/v3/projects/db5b881503054c77b0b408245f38b841/users/3de5f2365e27479b8459536c08d4fd8f/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:54.671111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.671401 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.671678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.699052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] MFA Rules not processed for user `3de5f2365e27479b8459536c08d4fd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:54.700257 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:54.765824 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1381/2755] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:54.778202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.779935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:54.837275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c7b2-0dbd-4429-b0c2-9d50d461bad4 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.840956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.841591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.841873 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.842148 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:54.851059 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:54.852979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:54.862381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1375/2756] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:54.948805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:54.958363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21e45-ee09-411f-8375-8c2cae7d577e None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:54.962007 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:54.962595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:54.962870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:54.963139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:55.020542 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:55.022015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:55.031422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1382/2757] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:07:59.316908 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:59.325487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13412535-bb2b-499e-8489-193e2253c6fd service cinder] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:59.329177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:59.329797 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:59.330076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:59.330345 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:59.332060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:59.396493 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:59.397977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47745b0-2e8c-44fb-befa-46aa0a67cac4 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:59.407623 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1376/2758] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:59.741705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:59.752403 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:59.807465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dea3f-37db-4be7-ba22-a7b54ac266a0 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:59.812046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:59.812681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:59.812960 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:59.813238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] PATH_INFO: `/v3/users/b7cba97fbb9749d9b39aa133e7c53319` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:59.814382 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cba97fbb9749d9b39aa133e7c53319)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:59.816290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:59.864457 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cba97fbb9749d9b39aa133e7c53319'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:59.865111 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cba97fbb9749d9b39aa133e7c53319'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:59.872959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cba97fbb9749d9b39aa133e7c53319'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:59.885141 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cba97fbb9749d9b39aa133e7c53319'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:59.892182 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cba97fbb9749d9b39aa133e7c53319'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:59.900032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1383/2759] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:59 2022] DELETE /identity/v3/users/b7cba97fbb9749d9b39aa133e7c53319 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:59.904846 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:59.908083 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:59.908374 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:59.927539 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:59.928747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:59.990793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1377/2760] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:00.001615 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:00.003013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:00.060497 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52802-d924-4498-83ba-875b8c3d93d0 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:00.064377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:00.064980 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:00.065273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:00.065588 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:00.077034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:00.078637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:00.092119 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1384/2761] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:00.438793 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:00.440349 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:00.455034 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2e2b3-ea03-4471-a691-f5f580cf8392 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:00.459896 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:00.460564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:00.460843 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:00.461111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] PATH_INFO: `/v3/projects/a50f9014da1e40afa0b517c7a8122c12` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:00.462256 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50f9014da1e40afa0b517c7a8122c12)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:00.464291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:00.494712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:00.513381 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50f9014da1e40afa0b517c7a8122c12', 'request_id': 'req-eb1e370e-a7d8-4822-a642-ff3324b46dab'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.519416 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50f9014da1e40afa0b517c7a8122c12', 'request_id': 'req-eb1e370e-a7d8-4822-a642-ff3324b46dab'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.526663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50f9014da1e40afa0b517c7a8122c12', 'request_id': 'req-eb1e370e-a7d8-4822-a642-ff3324b46dab'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.537132 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] The token cache is being invalidate because project a50f9014da1e40afa0b517c7a8122c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:00.537449 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.538069 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.539555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1378/2762] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:00 2022] DELETE /identity/v3/projects/a50f9014da1e40afa0b517c7a8122c12 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:00.543529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:00.553489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889407e1-b0a9-4c68-9f14-c72c8a54636f service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:00.583105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:00.611029 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:00.611569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:00.611846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:00.612118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] PATH_INFO: `/v3/users/3de5f2365e27479b8459536c08d4fd8f` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:00.613224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de5f2365e27479b8459536c08d4fd8f)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:00.615155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:00.660552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de5f2365e27479b8459536c08d4fd8f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.661196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de5f2365e27479b8459536c08d4fd8f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.668503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de5f2365e27479b8459536c08d4fd8f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.680939 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de5f2365e27479b8459536c08d4fd8f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.687775 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-f0521513-bd3e-4535-b10e-556a2073e3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de5f2365e27479b8459536c08d4fd8f'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:00.693627 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1385/2763] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:00 2022] DELETE /identity/v3/users/3de5f2365e27479b8459536c08d4fd8f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:00.967654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:00.969106 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:00.982618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e370e-a7d8-4822-a642-ff3324b46dab admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.047480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.048119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.048403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.048706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] PATH_INFO: `/v3/projects/db5b881503054c77b0b408245f38b841` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.049868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5b881503054c77b0b408245f38b841)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.051951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.098295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5b881503054c77b0b408245f38b841', 'request_id': 'req-b17631bb-f980-4fd0-86e6-de510f6956df'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:01.104825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5b881503054c77b0b408245f38b841', 'request_id': 'req-b17631bb-f980-4fd0-86e6-de510f6956df'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:01.111976 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5b881503054c77b0b408245f38b841', 'request_id': 'req-b17631bb-f980-4fd0-86e6-de510f6956df'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:01.122407 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] The token cache is being invalidate because project db5b881503054c77b0b408245f38b841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:01.122811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:01.123445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-b17631bb-f980-4fd0-86e6-de510f6956df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:01.124912 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1379/2764] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:00 2022] DELETE /identity/v3/projects/db5b881503054c77b0b408245f38b841 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:01.129788 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.130245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.130366 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.150244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:01.151390 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:01.208548 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1386/2765] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:01.217784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.218067 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.218337 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.237931 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:01.239114 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:01.246881 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1380/2766] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:01.251122 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.261155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f855608-a686-4ee7-b63e-2630a7e62ec4 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.266372 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.267034 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.267335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.267665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.268306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:01.268608 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.270204 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.282331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1387/2767] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:01.286543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.296390 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e7d4b-ce3e-47f3-9d9d-4e887ba78bb6 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.301079 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.301702 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.302275 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.302566 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.303198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.305087 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.334467 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1381/2768] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:01.338049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.348738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64cfd-92be-4fa4-a5f1-195cb3661897 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.388046 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:01.416402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.417118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.417501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.417780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.418416 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.420360 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.446958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1388/2769] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:01.448238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.460160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b412b4-a3c0-483b-ba04-a12c1dab88b4 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.465970 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.466607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.467082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.467455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.468301 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.469991 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.480660 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1382/2770] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:01.484687 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.494530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab02e1-2cc9-4ba3-8807-8726df79f41b admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.499156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a001a2-ab44-4520-a1e9-f8997a89bc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.499750 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a001a2-ab44-4520-a1e9-f8997a89bc58 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.500031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a001a2-ab44-4520-a1e9-f8997a89bc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.500302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a001a2-ab44-4520-a1e9-f8997a89bc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.500936 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a001a2-ab44-4520-a1e9-f8997a89bc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.502551 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a001a2-ab44-4520-a1e9-f8997a89bc58 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.512752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1389/2771] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:01.516641 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.523047 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:01.527564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5682-9d5b-45fa-8284-6dfbf00f434b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.533592 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.534413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.534916 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.535215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] PATH_INFO: `/v3/projects/2a320ac70d2f44d5a46b33c636867d4c/users/22186a9c4ba6404aa5f26627f104b8a0/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.549868 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a320ac70d2f44d5a46b33c636867d4c, user_id=22186a9c4ba6404aa5f26627f104b8a0, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.552473 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.565435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1383/2772] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:01 2022] PUT /identity/v3/projects/2a320ac70d2f44d5a46b33c636867d4c/users/22186a9c4ba6404aa5f26627f104b8a0/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:01.576297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.576581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.576855 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.603731 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] MFA Rules not processed for user `22186a9c4ba6404aa5f26627f104b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:01.604918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:01.666128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1390/2773] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:01.671653 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.734789 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796ba47-027b-4a2e-a4e5-7e6873b3ef5d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.739553 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.740161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.740476 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.740750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.741410 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.743368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.771171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1384/2774] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:01.775928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.787315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626ca93-62d8-4b04-82d5-a8cb99fc244b None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.846247 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.846858 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.847135 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.847404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.848021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.849963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.871451 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1391/2775] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:01 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:01.875559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.886395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6003117-2d7c-4e56-9dd0-b05e8d927a02 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.891068 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.891827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.892182 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.892844 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.893459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.895484 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.907185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1385/2776] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:08:01.911930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.921923 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f783ec-9ee8-44e2-ba64-4829ec3ac2f6 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.926585 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.927244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.927526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.927802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] PATH_INFO: `/v3/projects/efacb413a2814a3b8418c1fa824986ec/users/750d4c4ee609456397eeb346d19a29fc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.943125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efacb413a2814a3b8418c1fa824986ec, user_id=750d4c4ee609456397eeb346d19a29fc, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:01.947333 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:01.963929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1392/2777] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:01 2022] PUT /identity/v3/projects/efacb413a2814a3b8418c1fa824986ec/users/750d4c4ee609456397eeb346d19a29fc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:01.967968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.979183 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871633-f354-4bbe-a442-a6a95e51fdf2 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:02.042295 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5323ee-0c93-4f1c-b0a1-dc3bad5a67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:02.042913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5323ee-0c93-4f1c-b0a1-dc3bad5a67bf admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:02.043195 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5323ee-0c93-4f1c-b0a1-dc3bad5a67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:02.043477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5323ee-0c93-4f1c-b0a1-dc3bad5a67bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:02.044116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5323ee-0c93-4f1c-b0a1-dc3bad5a67bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:02.045806 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5323ee-0c93-4f1c-b0a1-dc3bad5a67bf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:02.057299 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1386/2778] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:02.067625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:02.078723 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfb229-e814-4c95-9a37-f29015eec002 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:02.084115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:02.084880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:02.085238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:02.085766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] PATH_INFO: `/v3/projects/efacb413a2814a3b8418c1fa824986ec/users/750d4c4ee609456397eeb346d19a29fc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:02.088354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efacb413a2814a3b8418c1fa824986ec, user_id=750d4c4ee609456397eeb346d19a29fc, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:02.092692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:02.099115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:02.113567 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1393/2779] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:02 2022] PUT /identity/v3/projects/efacb413a2814a3b8418c1fa824986ec/users/750d4c4ee609456397eeb346d19a29fc/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:02.116026 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:02.116314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:02.116593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:02.147757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] MFA Rules not processed for user `750d4c4ee609456397eeb346d19a29fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:02.149223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:02.317792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:02.348375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1387/2780] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:02.360408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:02.362217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:02.419154 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d42cf7-6107-4999-a1d1-1d569975cf31 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:02.422812 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:02.423410 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:02.423691 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:02.423963 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:02.433708 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:02.435071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:02.444446 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1394/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:02.516622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:02.526372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cb1aa-0e69-4538-b439-84308f630d3c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:02.530475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9170-5a06-42bf-b52f-a7b30255f7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:02.531082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9170-5a06-42bf-b52f-a7b30255f7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:02.531492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9170-5a06-42bf-b52f-a7b30255f7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:02.531769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9170-5a06-42bf-b52f-a7b30255f7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:02.614712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9170-5a06-42bf-b52f-a7b30255f7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:02.616254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9170-5a06-42bf-b52f-a7b30255f7a2 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:02.626968 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1388/2782] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:02.893144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:02.957327 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8f7ef-8b73-4d6b-ac50-4289b66c90be service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:02.962351 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:02.963099 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:02.963275 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:02.963543 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] PATH_INFO: `/v3/users/22186a9c4ba6404aa5f26627f104b8a0` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:02.964631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22186a9c4ba6404aa5f26627f104b8a0)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:02.966607 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:03.011321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22186a9c4ba6404aa5f26627f104b8a0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.011966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22186a9c4ba6404aa5f26627f104b8a0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.018956 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22186a9c4ba6404aa5f26627f104b8a0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.031845 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22186a9c4ba6404aa5f26627f104b8a0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.038797 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22186a9c4ba6404aa5f26627f104b8a0'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.044630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1395/2783] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:02 2022] DELETE /identity/v3/users/22186a9c4ba6404aa5f26627f104b8a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:03.049177 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:03.049487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:03.049764 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:03.068220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:03.069455 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:03.125665 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1389/2784] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:03.135771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:03.137158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:03.159645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:03.196238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f67f5-d8dd-4633-aa9b-1da671658a63 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:03.199928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:03.200526 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:03.200804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:03.201075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:03.210051 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:03.211502 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:03.221149 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1396/2785] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:03.488888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:03.490406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:03.503294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc0c0-01ca-49c9-90f6-a68cd9202d74 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:03.509304 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:03.511194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:03.511194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:03.511194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] PATH_INFO: `/v3/projects/2a320ac70d2f44d5a46b33c636867d4c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:03.511699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a320ac70d2f44d5a46b33c636867d4c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:03.514134 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:03.560254 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a320ac70d2f44d5a46b33c636867d4c', 'request_id': 'req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.566174 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a320ac70d2f44d5a46b33c636867d4c', 'request_id': 'req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.574192 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a320ac70d2f44d5a46b33c636867d4c', 'request_id': 'req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.580744 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:03.586685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] The token cache is being invalidate because project 2a320ac70d2f44d5a46b33c636867d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:03.587330 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.588384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.590315 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1390/2786] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:03 2022] DELETE /identity/v3/projects/2a320ac70d2f44d5a46b33c636867d4c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:03.594052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:03.604319 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da986e4-18f2-43f6-a26e-4e7331f40085 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:03.664501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:03.665164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:03.665469 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:03.665781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] PATH_INFO: `/v3/users/750d4c4ee609456397eeb346d19a29fc` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:03.666854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750d4c4ee609456397eeb346d19a29fc)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:03.668912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:03.716130 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750d4c4ee609456397eeb346d19a29fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.717013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750d4c4ee609456397eeb346d19a29fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.724549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750d4c4ee609456397eeb346d19a29fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.739415 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750d4c4ee609456397eeb346d19a29fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.746285 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-d23c3573-9eaa-4aa5-9424-afc10e4845f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750d4c4ee609456397eeb346d19a29fc'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:03.752123 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1397/2787] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:03 2022] DELETE /identity/v3/users/750d4c4ee609456397eeb346d19a29fc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:04.037213 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.039257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:04.053406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aebfd-4e72-42ec-be02-9e1b0a1d163b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.110775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.111403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.111681 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.111975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] PATH_INFO: `/v3/projects/efacb413a2814a3b8418c1fa824986ec` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.113071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efacb413a2814a3b8418c1fa824986ec)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.114986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.162829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efacb413a2814a3b8418c1fa824986ec', 'request_id': 'req-ae4cbeea-397a-4d18-b156-14c69de8e832'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:04.168723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efacb413a2814a3b8418c1fa824986ec', 'request_id': 'req-ae4cbeea-397a-4d18-b156-14c69de8e832'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:04.175714 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efacb413a2814a3b8418c1fa824986ec', 'request_id': 'req-ae4cbeea-397a-4d18-b156-14c69de8e832'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:04.186212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] The token cache is being invalidate because project efacb413a2814a3b8418c1fa824986ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:04.186495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:04.187118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-ae4cbeea-397a-4d18-b156-14c69de8e832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:04.188547 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1391/2788] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:04 2022] DELETE /identity/v3/projects/efacb413a2814a3b8418c1fa824986ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:04.194191 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.194479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.194760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.214290 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:04.215492 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:04.252705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:04.275330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1398/2789] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:04.338564 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.338850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.339116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.358428 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:04.359612 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:04.367828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1392/2790] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:04.372054 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.381971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba9e40-a1b8-4586-93e5-99cb2a9dc9c3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.387088 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.387689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.387971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.388249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.388919 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:04.389223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.390838 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.402724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1399/2791] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:04.407257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.418001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91da1-3ad0-4bbd-a912-e5da1269e1c3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.422769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.423423 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.423726 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.424045 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.424731 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.426629 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.454362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1393/2792] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:04 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:04.458599 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.468395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a12c5-93c1-42c7-802d-2206d6a79107 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.527158 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.527694 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.527973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.528244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.528863 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.530941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.555680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1400/2793] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:04 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:04.557444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.567837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37886ca-02bb-422a-bd62-09bf5545dcf4 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.572535 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.573121 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.573430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.573700 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.574325 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.575909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.585663 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1394/2794] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:04.589647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.599465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967c113-79fa-4651-aec8-c22a713838f4 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.604559 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393720-cb61-4c84-8d5d-27392e135914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.605150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393720-cb61-4c84-8d5d-27392e135914 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.605471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393720-cb61-4c84-8d5d-27392e135914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.605746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393720-cb61-4c84-8d5d-27392e135914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.606376 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4393720-cb61-4c84-8d5d-27392e135914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.607941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4393720-cb61-4c84-8d5d-27392e135914 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.619890 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1401/2795] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:04.623886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.633608 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f94cb-a9b3-4599-9fd5-b06cd0ce3c77 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.638135 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.638791 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.639066 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.639336 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] PATH_INFO: `/v3/projects/0db6cfc1bf1449468e922f6ad8822c3d/users/52ec549bc27043659adf98b7a94ecec8/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.654418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db6cfc1bf1449468e922f6ad8822c3d, user_id=52ec549bc27043659adf98b7a94ecec8, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.656977 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.669785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1395/2796] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:04 2022] PUT /identity/v3/projects/0db6cfc1bf1449468e922f6ad8822c3d/users/52ec549bc27043659adf98b7a94ecec8/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:04.679689 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.680015 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.680295 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.707315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] MFA Rules not processed for user `52ec549bc27043659adf98b7a94ecec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:04.708515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:04.771377 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1402/2797] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:04.783829 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.785648 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:04.812466 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:04.843898 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a9c5f-add8-412d-a481-74e7d433c2a9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.847527 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.848124 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.848403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.848676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.856779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.858287 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.867440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1396/2798] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:14.768420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:14.862996 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=15 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:19.348090 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:19.349586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:19.415089 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818c1af-1dcd-45cf-ad45-a85cf269de3f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:19.420112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:19.420740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:19.421018 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:19.421315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] PATH_INFO: `/v3/users/32bd216e99f94bb9a6a1bb7097bd5636` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:19.422536 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bd216e99f94bb9a6a1bb7097bd5636)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:19.424558 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:19.470429 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bd216e99f94bb9a6a1bb7097bd5636'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.471102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bd216e99f94bb9a6a1bb7097bd5636'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.478199 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bd216e99f94bb9a6a1bb7097bd5636'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.489889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bd216e99f94bb9a6a1bb7097bd5636'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.496661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bd216e99f94bb9a6a1bb7097bd5636'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.502424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1403/2799] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:19 2022] DELETE /identity/v3/users/32bd216e99f94bb9a6a1bb7097bd5636 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:19.673699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:19.686270 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0679ced-cddf-4676-bc20-320c75500a3d service glance] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:19.743563 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:19.744126 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:19.744405 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:19.744679 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] PATH_INFO: `/v3/projects/eae15cc36d5e4d2295eb694042c547cd` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:19.745811 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae15cc36d5e4d2295eb694042c547cd)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:19.747705 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:19.792915 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae15cc36d5e4d2295eb694042c547cd', 'request_id': 'req-eea70266-23ab-4041-88c0-53c7b1be9fcb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.798875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae15cc36d5e4d2295eb694042c547cd', 'request_id': 'req-eea70266-23ab-4041-88c0-53c7b1be9fcb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.807699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae15cc36d5e4d2295eb694042c547cd', 'request_id': 'req-eea70266-23ab-4041-88c0-53c7b1be9fcb'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.817832 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] The token cache is being invalidate because project eae15cc36d5e4d2295eb694042c547cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:19.818116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.818720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.820201 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1397/2800] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:19 2022] DELETE /identity/v3/projects/eae15cc36d5e4d2295eb694042c547cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:19.824157 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:19.825555 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:19.838879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131767-53c6-49f8-954f-58335d0cab09 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:19.894287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:19.895144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:19.895467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:19.895874 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] PATH_INFO: `/v3/users/b3430280090b40a782b5fecc89f403c4` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:19.897140 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3430280090b40a782b5fecc89f403c4)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:19.899581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:19.921380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:19.945315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3430280090b40a782b5fecc89f403c4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.945962 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3430280090b40a782b5fecc89f403c4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.952879 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3430280090b40a782b5fecc89f403c4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.965096 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3430280090b40a782b5fecc89f403c4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.971802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-ba4f6965-cf2e-48f2-82b0-c7795a7ea821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3430280090b40a782b5fecc89f403c4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:19.978641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1404/2801] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:19 2022] DELETE /identity/v3/users/b3430280090b40a782b5fecc89f403c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:20.153185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.154719 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.167835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea70266-23ab-4041-88c0-53c7b1be9fcb admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.223598 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.224229 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.224503 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.224768 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] PATH_INFO: `/v3/projects/6f8d02641d0e4707ac22333c2ee50c53` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.225890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8d02641d0e4707ac22333c2ee50c53)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.227762 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.260651 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:20.273741 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8d02641d0e4707ac22333c2ee50c53', 'request_id': 'req-26954f06-7a96-4ca4-a08c-180e7316a67e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:20.280120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8d02641d0e4707ac22333c2ee50c53', 'request_id': 'req-26954f06-7a96-4ca4-a08c-180e7316a67e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:20.291477 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8d02641d0e4707ac22333c2ee50c53', 'request_id': 'req-26954f06-7a96-4ca4-a08c-180e7316a67e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:20.301767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] The token cache is being invalidate because project 6f8d02641d0e4707ac22333c2ee50c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:20.302050 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:20.302664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-26954f06-7a96-4ca4-a08c-180e7316a67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:20.304160 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1398/2802] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:20 2022] DELETE /identity/v3/projects/6f8d02641d0e4707ac22333c2ee50c53 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:20.309058 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.309384 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.309669 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.329495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.330697 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.389503 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1405/2803] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.397184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.398091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.398368 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.418020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.419226 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.427051 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1399/2804] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.431189 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.440911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69d64-3e50-4154-b2b1-82fccdac4d9f None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.446027 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.446617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.446912 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.447169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.447807 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:20.448110 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.449730 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.461645 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1406/2805] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:20.465825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.474909 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944abc23-ab9f-4f37-a0e6-029fc8fdf93e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.479582 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.480164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.480442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.480710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.481353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.483248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.510167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1400/2806] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:20.513976 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.524468 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebe717-6724-4eb5-845b-6511c1d97ab8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.579013 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.579780 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.580166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.580483 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.581104 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.583033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.603579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1407/2807] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:20.607685 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.618176 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e996a4-789c-42d6-8b88-ff1ede7a9e63 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.622778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.623559 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.623692 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.623879 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.624506 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.626128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.639321 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1401/2808] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:20.641053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.651310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95de4d-b4e9-49cd-9a1f-550461f0bcc8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.656166 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd7dad-0315-4322-9361-e0fc429a4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.656748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7dad-0315-4322-9361-e0fc429a4173 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.657030 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7dad-0315-4322-9361-e0fc429a4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.657335 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7dad-0315-4322-9361-e0fc429a4173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.657978 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd7dad-0315-4322-9361-e0fc429a4173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.659554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd7dad-0315-4322-9361-e0fc429a4173 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.670148 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1408/2809] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:20.674294 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.684785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dea01-aeed-44ac-ae14-699a75a31a3b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.689352 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.689993 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.690272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.691468 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] PATH_INFO: `/v3/projects/9017deb9a304494cb08514cd329ef2c6/users/ed7aa9cef12b4410beee72df236d06eb/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.706266 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9017deb9a304494cb08514cd329ef2c6, user_id=ed7aa9cef12b4410beee72df236d06eb, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.708863 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.721952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1402/2810] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:20 2022] PUT /identity/v3/projects/9017deb9a304494cb08514cd329ef2c6/users/ed7aa9cef12b4410beee72df236d06eb/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:20.732075 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.732365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.732641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.740564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:20.760982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] MFA Rules not processed for user `ed7aa9cef12b4410beee72df236d06eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.762242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.825249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1409/2811] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.836168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.837920 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.895500 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fb37-e996-4994-aa9b-7f4062edf9d6 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.899624 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61cbfb-43dd-4db0-8dc7-25c7454d801f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.900234 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cbfb-43dd-4db0-8dc7-25c7454d801f service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.900514 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cbfb-43dd-4db0-8dc7-25c7454d801f service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.900788 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cbfb-43dd-4db0-8dc7-25c7454d801f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.909398 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61cbfb-43dd-4db0-8dc7-25c7454d801f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.910820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61cbfb-43dd-4db0-8dc7-25c7454d801f service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.919404 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1403/2812] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:20.940857 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.002467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb090df9-cd4f-4a35-8f75-605ed6cd4a1c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.007014 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.007630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.007910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.008181 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] PATH_INFO: `/v3/users/ed7aa9cef12b4410beee72df236d06eb` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.009321 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7aa9cef12b4410beee72df236d06eb)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.011226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.056177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7aa9cef12b4410beee72df236d06eb'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.056847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7aa9cef12b4410beee72df236d06eb'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.064105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7aa9cef12b4410beee72df236d06eb'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.075887 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7aa9cef12b4410beee72df236d06eb'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.082749 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7aa9cef12b4410beee72df236d06eb'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.089026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1410/2813] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:20 2022] DELETE /identity/v3/users/ed7aa9cef12b4410beee72df236d06eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:21.093342 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.093664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.093941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.113429 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.114666 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.164792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:21.178039 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1404/2814] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.184961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.186442 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.200521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:21.245495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465565-8fe0-44ee-8aa2-87f2f59129e8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.249231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef1b87-1b09-47af-8147-4e4200bf9442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.249868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef1b87-1b09-47af-8147-4e4200bf9442 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.250150 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef1b87-1b09-47af-8147-4e4200bf9442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.250424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef1b87-1b09-47af-8147-4e4200bf9442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.259364 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef1b87-1b09-47af-8147-4e4200bf9442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.260789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef1b87-1b09-47af-8147-4e4200bf9442 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.270239 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1411/2815] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:21.543340 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.544838 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.556827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e3fa0-a06c-4b1a-8c59-23bc905fed8b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.561469 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.562099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.562379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.562650 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] PATH_INFO: `/v3/projects/9017deb9a304494cb08514cd329ef2c6` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.563763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9017deb9a304494cb08514cd329ef2c6)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.565798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.612636 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9017deb9a304494cb08514cd329ef2c6', 'request_id': 'req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.618676 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9017deb9a304494cb08514cd329ef2c6', 'request_id': 'req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.625994 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9017deb9a304494cb08514cd329ef2c6', 'request_id': 'req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.636298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] The token cache is being invalidate because project 9017deb9a304494cb08514cd329ef2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:21.636590 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.637202 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8fd10f3a-6bd5-4ef9-957b-99c444ea062a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:21.638698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1405/2816] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:21 2022] DELETE /identity/v3/projects/9017deb9a304494cb08514cd329ef2c6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:21.643653 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.644137 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.644246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.664187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.665430 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.722910 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1412/2817] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.731750 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.732222 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.732344 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.751480 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.752699 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.760978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1406/2818] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.765223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.775278 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b837eb-83bb-4965-8bf1-79dae72f513c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.780059 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.780647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.780926 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.781198 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.781876 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:21.782177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.783774 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.795035 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1413/2819] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.799116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.808262 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550581-59b3-4862-8c72-e1410edf11cf None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.812849 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.813482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.813747 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.814016 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.814664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.816490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.843752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1407/2820] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.847842 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.857719 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f0d93-2556-4411-9f6f-0a9cd0a6acad admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.913183 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.913914 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.914196 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.914471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.915081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.917012 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.937354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1414/2821] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.941427 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.952031 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08a96-a9e0-43f6-9890-0ba805647bcf admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.957639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.958248 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.958529 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.958830 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.959475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.961682 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.972790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1408/2822] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:21.976839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.987472 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78018b-24f2-4907-a0d6-e76d0a2b7283 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.992346 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5502ed-a67d-40ff-9b53-16dc113544fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.992943 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5502ed-a67d-40ff-9b53-16dc113544fc admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.993224 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5502ed-a67d-40ff-9b53-16dc113544fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.993530 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5502ed-a67d-40ff-9b53-16dc113544fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.994165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5502ed-a67d-40ff-9b53-16dc113544fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.995760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5502ed-a67d-40ff-9b53-16dc113544fc admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.006479 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1415/2823] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:08:22.010990 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.020820 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c9ac7-dde2-4c07-9232-327a23d7ea4d admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.026018 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.026654 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.027185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.027456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] PATH_INFO: `/v3/projects/6f51beec8ec74807a867cf882f19054c/users/64abff49049a48319429c00bb679d0e0/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.041552 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f51beec8ec74807a867cf882f19054c, user_id=64abff49049a48319429c00bb679d0e0, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.044194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.057133 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1409/2824] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:22 2022] PUT /identity/v3/projects/6f51beec8ec74807a867cf882f19054c/users/64abff49049a48319429c00bb679d0e0/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:22.067305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.067609 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.067870 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.096139 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] MFA Rules not processed for user `64abff49049a48319429c00bb679d0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:22.097386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:22.106309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:22.162194 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1416/2825] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:22.176810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.179107 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:22.234255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbb29-b28d-4c4a-89f7-9c9c6da99371 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.237891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd46d97-115c-4bde-94d4-f8cb9d3eb326 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51791d40886b419fbaf269508382702e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.238487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd46d97-115c-4bde-94d4-f8cb9d3eb326 service glance] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.238767 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd46d97-115c-4bde-94d4-f8cb9d3eb326 service glance] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.239040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd46d97-115c-4bde-94d4-f8cb9d3eb326 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.247658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd46d97-115c-4bde-94d4-f8cb9d3eb326 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.249073 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd46d97-115c-4bde-94d4-f8cb9d3eb326 service glance] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.258251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1410/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:32.159309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=22 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:32.253945 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:32.697547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.698944 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.764942 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f09519-2667-4a62-89cd-2385297be267 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:32.769493 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:32.770125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.770404 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.770680 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] PATH_INFO: `/v3/users/52ec549bc27043659adf98b7a94ecec8` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.772311 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ec549bc27043659adf98b7a94ecec8)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:32.774259 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:32.824752 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ec549bc27043659adf98b7a94ecec8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.825449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ec549bc27043659adf98b7a94ecec8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.832996 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ec549bc27043659adf98b7a94ecec8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.845541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ec549bc27043659adf98b7a94ecec8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.852819 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ec549bc27043659adf98b7a94ecec8'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.858705 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1417/2827] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:32 2022] DELETE /identity/v3/users/52ec549bc27043659adf98b7a94ecec8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:32.863171 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.863456 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.863729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.881979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:32.883264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.943453 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1411/2828] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:32.954349 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.955882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.015112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fb06-13fc-45c1-8fc6-616f2975bf5c admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.019639 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69806900-8411-4e3b-a150-213320361ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.020245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69806900-8411-4e3b-a150-213320361ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.020524 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69806900-8411-4e3b-a150-213320361ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.020796 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69806900-8411-4e3b-a150-213320361ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.031760 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69806900-8411-4e3b-a150-213320361ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.033409 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69806900-8411-4e3b-a150-213320361ee2 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.043977 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1418/2829] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:33.337893 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.339418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.353459 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca858ab-0ca5-46f4-a83a-114d5ba339e7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.358554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.359184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.359452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.360375 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] PATH_INFO: `/v3/projects/0db6cfc1bf1449468e922f6ad8822c3d` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.361532 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db6cfc1bf1449468e922f6ad8822c3d)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.363634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.410943 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db6cfc1bf1449468e922f6ad8822c3d', 'request_id': 'req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:33.417524 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db6cfc1bf1449468e922f6ad8822c3d', 'request_id': 'req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:33.424783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db6cfc1bf1449468e922f6ad8822c3d', 'request_id': 'req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:33.436193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] The token cache is being invalidate because project 0db6cfc1bf1449468e922f6ad8822c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:33.436483 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:33.437154 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-da32e3aa-9c13-419b-8b40-8c2a0d744fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:33.438646 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1412/2830] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:33 2022] DELETE /identity/v3/projects/0db6cfc1bf1449468e922f6ad8822c3d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:33.443619 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.444147 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.444267 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.463847 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:33.464947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.481720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:33.529951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1419/2831] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:33.539718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.540002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.540272 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.559870 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:33.561200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.569413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1413/2832] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:33.573449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.583190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b356c08-cb70-4fae-8088-5691d16027a3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.588202 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.588802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.589071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.589386 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.590026 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:33.590323 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.591929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.603868 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1420/2833] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:33.607911 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.617112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb236e2-cb84-44be-8af4-0b401daf1002 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.622094 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.622769 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.623085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.623359 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.624042 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.626091 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.653577 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1414/2834] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:33.657772 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.668165 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d590c-8f0b-4732-9cf2-c2aa20c55a13 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.726040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.726562 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.726846 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.727128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.727763 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.729732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.750776 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1421/2835] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:33.754886 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.766785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc0cf1-b426-408e-9e91-51a75a4a60fd admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.772533 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.773191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.773470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.773737 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.774384 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.775953 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.786088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1415/2836] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:33.790128 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.800711 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504e8ac-847c-4c14-aa47-fed69bdb8729 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.805471 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff25d8-26d7-4c4c-b778-8b306b07af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.806095 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff25d8-26d7-4c4c-b778-8b306b07af7b admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.806374 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff25d8-26d7-4c4c-b778-8b306b07af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.806647 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff25d8-26d7-4c4c-b778-8b306b07af7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.807279 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff25d8-26d7-4c4c-b778-8b306b07af7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.808854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff25d8-26d7-4c4c-b778-8b306b07af7b admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.819884 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1422/2837] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:33.823951 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.834084 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6bacc-719f-4958-82ed-8c5ec7a6522f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.839163 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.839801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.840088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.840362 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] PATH_INFO: `/v3/projects/f76e8cd706d0481e8ca9e40901752cbf/users/e74469b727af4fcfa0afb850ffca2a6d/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.854269 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76e8cd706d0481e8ca9e40901752cbf, user_id=e74469b727af4fcfa0afb850ffca2a6d, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.856875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.869191 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1416/2838] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:33 2022] PUT /identity/v3/projects/f76e8cd706d0481e8ca9e40901752cbf/users/e74469b727af4fcfa0afb850ffca2a6d/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:33.874112 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d6e8-cb8c-4a7a-ac82-b3d6cf0b2b48 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.874399 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d6e8-cb8c-4a7a-ac82-b3d6cf0b2b48 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.874674 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d6e8-cb8c-4a7a-ac82-b3d6cf0b2b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.893724 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-6095d6e8-cb8c-4a7a-ac82-b3d6cf0b2b48 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:33.895375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-6095d6e8-cb8c-4a7a-ac82-b3d6cf0b2b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.957244 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1423/2839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:33.967505 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.969314 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.990722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:34.028706 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce6b6b-19a7-404d-b748-6b96f6f964d1 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.032306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.032978 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.033278 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.033554 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.042959 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.044370 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.054220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1417/2840] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:37.715541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.716024 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.716156 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.750571 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] MFA Rules not processed for user `e74469b727af4fcfa0afb850ffca2a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:37.751893 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.769628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:37.820293 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1424/2841] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:37.824782 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.835622 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580ad89-2eab-4e5d-8331-b0a244d4f3c0 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.841611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.842220 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.842504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.842776 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.843399 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.845376 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.873704 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1418/2842] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:37.877692 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.888880 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e12c5-9a4c-4ee6-bb1b-f88ce4afc59d None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.950348 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.950959 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.951243 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.951515 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.952136 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.954081 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.983047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1425/2843] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:37.984418 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.995221 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f021-38bc-4ba2-8f05-65c1e8c397ec admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.001597 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.002347 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.002763 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.003109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.003859 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.006116 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.028056 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1419/2844] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:38.031931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.043197 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457692a3-4100-4568-93b9-d0ea7d2c21b8 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.048294 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.049325 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.049854 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.050223 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] PATH_INFO: `/v3/projects/c0c47ec1496a4c24933dc98748666605/users/42f1e8b05a9c48e4b24590f466ac3fec/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.068605 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c47ec1496a4c24933dc98748666605, user_id=42f1e8b05a9c48e4b24590f466ac3fec, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.071282 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.090889 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1426/2845] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:38 2022] PUT /identity/v3/projects/c0c47ec1496a4c24933dc98748666605/users/42f1e8b05a9c48e4b24590f466ac3fec/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:38.094596 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.105892 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16f9c-4fa5-4bc9-a696-de1e382579da admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.181424 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669074d1-b9ac-46ed-a5d4-f95c2a2d0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.182230 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669074d1-b9ac-46ed-a5d4-f95c2a2d0793 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.182607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669074d1-b9ac-46ed-a5d4-f95c2a2d0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.182975 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669074d1-b9ac-46ed-a5d4-f95c2a2d0793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.183756 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669074d1-b9ac-46ed-a5d4-f95c2a2d0793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.185490 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669074d1-b9ac-46ed-a5d4-f95c2a2d0793 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.197379 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1420/2846] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:38.201208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.218216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ecc1-5fe1-46f2-b86a-188fdcda4059 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.226318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.227031 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.227309 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.227582 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] PATH_INFO: `/v3/projects/c0c47ec1496a4c24933dc98748666605/users/42f1e8b05a9c48e4b24590f466ac3fec/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.229613 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c47ec1496a4c24933dc98748666605, user_id=42f1e8b05a9c48e4b24590f466ac3fec, role_id=df08c84d347e4a03bd9aa2e9ee1f5ba3)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.232488 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.245449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1427/2847] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:38 2022] PUT /identity/v3/projects/c0c47ec1496a4c24933dc98748666605/users/42f1e8b05a9c48e4b24590f466ac3fec/roles/df08c84d347e4a03bd9aa2e9ee1f5ba3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:42.971161 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.971625 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.972002 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.015363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] MFA Rules not processed for user `42f1e8b05a9c48e4b24590f466ac3fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:43.016743 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.106046 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1421/2848] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:43.123541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.125933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.225047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ebf5a-76b4-47f5-ad75-5ad0999bcc3a admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.232340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53386e-8ff9-4015-9c34-203724a810f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.232961 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53386e-8ff9-4015-9c34-203724a810f5 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.233238 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53386e-8ff9-4015-9c34-203724a810f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.233729 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53386e-8ff9-4015-9c34-203724a810f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.240003 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:43.304972 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53386e-8ff9-4015-9c34-203724a810f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.306717 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53386e-8ff9-4015-9c34-203724a810f5 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.316646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1428/2849] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:44.299607 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.301193 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.316060 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:44.387823 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfe069-5fc9-4ced-82f8-5c7229e70a3d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.388331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfe069-5fc9-4ced-82f8-5c7229e70a3d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.388422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfe069-5fc9-4ced-82f8-5c7229e70a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.398765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69d40-a0fd-492c-9562-71c2d1d3bd18 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.403778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.404854 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.405141 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.405462 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] PATH_INFO: `/v3/users/64abff49049a48319429c00bb679d0e0` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.408024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64abff49049a48319429c00bb679d0e0)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.411037 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.414445 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-03cfe069-5fc9-4ced-82f8-5c7229e70a3d None None] MFA Rules not processed for user `e74469b727af4fcfa0afb850ffca2a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:44.415915 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-03cfe069-5fc9-4ced-82f8-5c7229e70a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.430740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1429/2850] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:44.476729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64abff49049a48319429c00bb679d0e0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.485353 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64abff49049a48319429c00bb679d0e0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.486212 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64abff49049a48319429c00bb679d0e0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.507320 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64abff49049a48319429c00bb679d0e0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.515396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64abff49049a48319429c00bb679d0e0'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.522444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1422/2851] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:44 2022] DELETE /identity/v3/users/64abff49049a48319429c00bb679d0e0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:44.527207 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.527701 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.528028 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.554979 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:44.556047 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.628581 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1430/2852] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:44.639928 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.641382 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.708718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df013-d660-4aa5-9e91-45c180f5b265 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.713591 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2640f-7b5d-439d-ab30-be3d89eb9cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.714319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2640f-7b5d-439d-ab30-be3d89eb9cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.714824 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2640f-7b5d-439d-ab30-be3d89eb9cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.715168 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2640f-7b5d-439d-ab30-be3d89eb9cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.727492 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2640f-7b5d-439d-ab30-be3d89eb9cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.728934 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2640f-7b5d-439d-ab30-be3d89eb9cf2 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.739383 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1423/2853] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:45.055236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.056828 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.070771 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b480c5-47f9-4b58-af01-00c712ad2f4c None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.075738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.076375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.076655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.076931 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] PATH_INFO: `/v3/projects/6f51beec8ec74807a867cf882f19054c` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.078091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f51beec8ec74807a867cf882f19054c)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.080000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.133941 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f51beec8ec74807a867cf882f19054c', 'request_id': 'req-a00d9cf9-09a5-4e7c-b46f-52b67192e025'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.141520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f51beec8ec74807a867cf882f19054c', 'request_id': 'req-a00d9cf9-09a5-4e7c-b46f-52b67192e025'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.150722 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f51beec8ec74807a867cf882f19054c', 'request_id': 'req-a00d9cf9-09a5-4e7c-b46f-52b67192e025'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.174160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] The token cache is being invalidate because project 6f51beec8ec74807a867cf882f19054c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:45.174839 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.175666 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-a00d9cf9-09a5-4e7c-b46f-52b67192e025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.177589 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1431/2854] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:45 2022] DELETE /identity/v3/projects/6f51beec8ec74807a867cf882f19054c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:45.185110 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.185520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.185861 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.207092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:45.208319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.239238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:45.277877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1424/2855] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:45.286825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.287894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.288631 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.319252 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:45.320806 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.329508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1432/2856] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:45.335088 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.351542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152a35e-1dfb-4e1c-ab84-7a9f0758bd6b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.358822 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.359508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.359799 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.360085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.360810 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:45.362414 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.363311 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.379510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1425/2857] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:45.383748 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.397010 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556decb3-4028-40eb-8b3e-be8e91d832d3 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.401129 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.402169 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.402529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.402809 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] PATH_INFO: `/v3/projects` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.403489 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.405578 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.423766 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:45.441983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1433/2858] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:45.443441 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.454583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a358f6-5107-4027-ad5e-feeafc0e9298 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.519085 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.519698 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.520007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.520283 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.522015 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.524095 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.554450 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1426/2859] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:45.555604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.566600 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c99e5-b81a-4758-8ea7-a78f5ba2742d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.571458 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.572066 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.572339 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.572637 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.573330 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.574902 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.586561 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1434/2860] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:45.590839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.601941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6e020-ec89-4deb-9df7-1667059ca02e admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.606718 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d07c-caf7-4f4a-bbf2-c0fcf4992bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.607328 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d07c-caf7-4f4a-bbf2-c0fcf4992bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.607616 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d07c-caf7-4f4a-bbf2-c0fcf4992bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.607888 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d07c-caf7-4f4a-bbf2-c0fcf4992bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.608530 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d07c-caf7-4f4a-bbf2-c0fcf4992bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.610167 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d07c-caf7-4f4a-bbf2-c0fcf4992bc2 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.621442 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1427/2861] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:45.625993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.637983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5c0e-4628-4b61-bd32-43a09c23f217 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.643255 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.643933 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.644213 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.644487 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] PATH_INFO: `/v3/projects/c6c60021199948dfa93221dfc2157f08/users/c33f878cb81b42ddacb61f106eb7294d/roles/b191ebef2f53453e846b638562cda626` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.661249 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c60021199948dfa93221dfc2157f08, user_id=c33f878cb81b42ddacb61f106eb7294d, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.665008 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.680076 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1435/2862] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:45 2022] PUT /identity/v3/projects/c6c60021199948dfa93221dfc2157f08/users/c33f878cb81b42ddacb61f106eb7294d/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:45.685200 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d816ca-2c95-4ae7-b18d-f397f2cd5535 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.685536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d816ca-2c95-4ae7-b18d-f397f2cd5535 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.685825 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d816ca-2c95-4ae7-b18d-f397f2cd5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.706120 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d9d816ca-2c95-4ae7-b18d-f397f2cd5535 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:45.707261 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d9d816ca-2c95-4ae7-b18d-f397f2cd5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.784757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1428/2863] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:45.794553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.796283 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.859678 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d19e95-121c-42de-aefc-bc492ad95a92 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.863420 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.864036 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.864391 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.864595 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.876953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.878452 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.888951 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1436/2864] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:46.656139 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530fa7-6549-4a4f-adae-86c41d9b3522 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.657076 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530fa7-6549-4a4f-adae-86c41d9b3522 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.657403 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530fa7-6549-4a4f-adae-86c41d9b3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.694288 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-90530fa7-6549-4a4f-adae-86c41d9b3522 None None] MFA Rules not processed for user `c33f878cb81b42ddacb61f106eb7294d`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:46.695583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-90530fa7-6549-4a4f-adae-86c41d9b3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.730794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:46.779891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1429/2865] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:46.790815 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.792209 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.851473 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2582-3fde-402a-ad10-196de75e7333 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.856287 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.856894 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.857171 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.857478 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.868755 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.870340 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.880037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1437/2866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:48.249223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:48.249765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:48.250189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:48.270070 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] MFA Rules not processed for user `c33f878cb81b42ddacb61f106eb7294d`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:48.272020 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:48.283017 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1430/2867] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:08:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:48.536019 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.537681 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:48.549783 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b64dd-69c0-4691-a009-7e5946ec4c33 service cinder] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:48.554802 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:48.555569 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:48.555917 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:48.556217 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:48.559115 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:48.571048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:48.572556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:48.581665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1438/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:48.943411 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.945470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:49.026250 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c373071-49b1-4804-8236-8ff671db0a9d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:49.032779 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:49.033437 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:49.033727 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:49.034003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:49.035757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:49.048432 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:49.049979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:49.060562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1431/2869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:50.841435 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:50.850547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6728-4711-41bd-8119-6e1d2108e289 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:50.854246 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:50.854853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:50.855131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:50.855405 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:50.857216 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:50.867810 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:50.869318 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:50.877827 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1439/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:51.545809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:51.547251 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:51.632157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62b82-9027-4251-83d0-ba7648bec88e service placement] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:51.637869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:51.638509 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:51.638790 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:51.639119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:51.640878 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:51.658082 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:51.659677 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:51.670396 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1432/2871] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:57.829661 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:57.844041 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f3177-0f8b-4d52-9e4d-42e4c223a274 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:57.849520 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:57.850117 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:57.850395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:57.850665 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:57.852371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:57.864610 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:57.866208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f9b00-3618-4e35-afdf-9e422fc21002 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:57.876740 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1440/2872] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:01.665835 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=83 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:07.872354 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:16.940157 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.950258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac871-e52e-4aaa-9e59-91bfbbd9f597 service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.953942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.954545 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.954827 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.955099 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.956853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:17.019583 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:17.021041 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:17.030765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1433/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:23.072541 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b05f0-1395-4c23-9c0a-1fc32627a0fb None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.073118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b05f0-1395-4c23-9c0a-1fc32627a0fb None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.073118 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b05f0-1395-4c23-9c0a-1fc32627a0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.092732 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-884b05f0-1395-4c23-9c0a-1fc32627a0fb None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:23.093973 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-884b05f0-1395-4c23-9c0a-1fc32627a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:23.102375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1441/2874] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:23.125611 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.137787 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540272-b562-41e4-9f70-1b0952d96759 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.143249 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.143839 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.144128 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.144402 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.153198 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.154792 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.164795 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1434/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:26.115618 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4423-4194-4960-b7f1-3877b486f7e7 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.116114 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4423-4194-4960-b7f1-3877b486f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.116236 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4423-4194-4960-b7f1-3877b486f7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.137738 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-358d4423-4194-4960-b7f1-3877b486f7e7 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:26.138930 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-358d4423-4194-4960-b7f1-3877b486f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:26.147124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1442/2876] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:26.167032 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.168452 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:26.183431 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a132-310e-4401-92cd-969e66cd7565 service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:26.188865 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:26.189482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.189765 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.190040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.198658 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:26.200210 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:26.209606 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1435/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:29.383266 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315a01-d786-42d7-b0eb-b40f14bcffa8 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.383767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315a01-d786-42d7-b0eb-b40f14bcffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.383916 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315a01-d786-42d7-b0eb-b40f14bcffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.404371 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-46315a01-d786-42d7-b0eb-b40f14bcffa8 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:29.405650 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-46315a01-d786-42d7-b0eb-b40f14bcffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:29.413617 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1443/2878] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:29.437003 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.448877 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8421f-3c30-4cb2-bade-514f70154ba6 service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.454372 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.454956 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.455238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.455510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.464203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.465823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.477140 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1436/2879] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:32.446642 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d8da-ee7e-47c1-8ae6-2e047083bf76 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:32.447155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d8da-ee7e-47c1-8ae6-2e047083bf76 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:32.447155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d8da-ee7e-47c1-8ae6-2e047083bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:32.466790 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-8509d8da-ee7e-47c1-8ae6-2e047083bf76 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:32.467982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-8509d8da-ee7e-47c1-8ae6-2e047083bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:32.475901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1444/2880] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:32.514395 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:32.526264 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb1482-73f3-42ed-b17c-14c2cd526d87 service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:32.532007 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:32.532593 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:32.532875 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:32.533150 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:32.541112 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:32.542710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:32.552001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1437/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:36.639955 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6799d-38cf-4571-885b-e076d86d266d None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.640423 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6799d-38cf-4571-885b-e076d86d266d None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.640538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6799d-38cf-4571-885b-e076d86d266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.659641 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-f4d6799d-38cf-4571-885b-e076d86d266d None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:36.660836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f4d6799d-38cf-4571-885b-e076d86d266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:36.669125 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1445/2882] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:36.691618 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:36.702694 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33771ad-9c0b-4d62-9340-8120f6bc94c1 service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:36.708048 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:36.708627 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.709544 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.709837 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.718217 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:36.719817 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:36.729880 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1438/2883] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:39.793966 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30a9f3-30b2-49ef-8e85-312fafddb1e1 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.794511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30a9f3-30b2-49ef-8e85-312fafddb1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.794511 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30a9f3-30b2-49ef-8e85-312fafddb1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.813155 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-dd30a9f3-30b2-49ef-8e85-312fafddb1e1 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:39.814369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-dd30a9f3-30b2-49ef-8e85-312fafddb1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.822037 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1446/2884] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:39.845319 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:39.856946 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1569-27b5-426f-931c-0a36a43621ab service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:39.862413 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fbb44-1605-4848-89b0-dabff6bf914e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:39.862998 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fbb44-1605-4848-89b0-dabff6bf914e service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.863279 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fbb44-1605-4848-89b0-dabff6bf914e service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.863549 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fbb44-1605-4848-89b0-dabff6bf914e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.871551 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fbb44-1605-4848-89b0-dabff6bf914e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:39.873097 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fbb44-1605-4848-89b0-dabff6bf914e service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:39.882470 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1439/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:49.809048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=18 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:49.878258 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=66 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:54.923547 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.924050 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.924167 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.942250 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] MFA Rules not processed for user `c33f878cb81b42ddacb61f106eb7294d`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:54.943439 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.950071 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1447/2886] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:04.937638 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=3 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:08.887720 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e02a-bf31-4606-824f-987886e407f9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.888253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e02a-bf31-4606-824f-987886e407f9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.888253 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e02a-bf31-4606-824f-987886e407f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.908872 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0427e02a-bf31-4606-824f-987886e407f9 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:08.910118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0427e02a-bf31-4606-824f-987886e407f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:08.917999 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1440/2887] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:08.943625 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.956918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c7929-98f9-4303-be9e-98652f75a391 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.962424 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.963052 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.963338 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.963612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.971572 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.973143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.982441 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1448/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:12.126942 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74975be-6f0c-4075-926a-9b5c38cb0a2f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:12.127482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74975be-6f0c-4075-926a-9b5c38cb0a2f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:12.127482 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74975be-6f0c-4075-926a-9b5c38cb0a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:12.146910 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d74975be-6f0c-4075-926a-9b5c38cb0a2f None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:12.148089 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d74975be-6f0c-4075-926a-9b5c38cb0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:12.156194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1441/2889] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:12.176655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:12.188550 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f2e0-3595-4b03-8673-709aa139f3e4 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:12.194049 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:12.195188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:12.195463 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:12.195735 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:12.203633 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:12.205190 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:12.214535 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1449/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:15.228333 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096631d-656f-43aa-801e-44c69344859e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.228855 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096631d-656f-43aa-801e-44c69344859e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.228979 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096631d-656f-43aa-801e-44c69344859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.247732 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b096631d-656f-43aa-801e-44c69344859e None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:15.248918 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b096631d-656f-43aa-801e-44c69344859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.256713 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1442/2891] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:15.280604 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.292315 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ceb51d-bf8b-43b4-ac44-90cde27799a9 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.297789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.298495 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.298782 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.299060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.307053 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.308659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:15.318143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1450/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:18.455965 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6b66-0ad6-4b9a-9374-4709a164364a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:18.456504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6b66-0ad6-4b9a-9374-4709a164364a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:18.456504 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6b66-0ad6-4b9a-9374-4709a164364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:18.475784 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-021e6b66-0ad6-4b9a-9374-4709a164364a None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:18.477024 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-021e6b66-0ad6-4b9a-9374-4709a164364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:18.484632 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1443/2893] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:18.508077 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:18.519302 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e7dd-5015-46cd-a987-c5dbb9daef07 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:18.524654 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:18.525242 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:18.525552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:18.525825 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:18.534079 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:18.535630 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:18.545508 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1451/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:22.569223 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.569752 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.569869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.588575 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:22.590291 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.598306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1444/2895] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:22.619698 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.630982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774758b2-6f9d-48a8-a2e8-a639b8cf0b52 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.636363 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.636948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.637222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.637521 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.645369 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.646920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.657193 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1452/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:32.583603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=15 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:32.651958 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=30 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:52.503536 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:52.515808 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e807a-b1cd-4035-a668-440fa016e567 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:52.520897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:52.521528 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.521809 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.522081 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.523783 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:52.536722 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:52.538255 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:52.549867 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1445/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:52.556612 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:52.566395 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75023219-a3aa-4eb4-908d-210beb3e4110 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:52.571215 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:52.572781 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.573160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.573554 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] PATH_INFO: `/v3/users/c33f878cb81b42ddacb61f106eb7294d` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.574795 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33f878cb81b42ddacb61f106eb7294d)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:52.576836 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:52.623929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33f878cb81b42ddacb61f106eb7294d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.624575 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33f878cb81b42ddacb61f106eb7294d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.631365 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33f878cb81b42ddacb61f106eb7294d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.643720 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33f878cb81b42ddacb61f106eb7294d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.650422 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-1bf1f4f8-d313-4424-b1da-0179c61125e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33f878cb81b42ddacb61f106eb7294d'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.657160 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1453/2898] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:52 2022] DELETE /identity/v3/users/c33f878cb81b42ddacb61f106eb7294d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:52.830755 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:52.841703 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc36ff-049f-41e7-aacd-4561818f83d6 service placement] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:52.898339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:52.898962 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.899243 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.899513 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] PATH_INFO: `/v3/projects/c6c60021199948dfa93221dfc2157f08` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.900605 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c60021199948dfa93221dfc2157f08)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:52.902510 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:52.948603 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c60021199948dfa93221dfc2157f08', 'request_id': 'req-f178c462-7034-4403-b78d-1953626dfd4e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.955259 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c60021199948dfa93221dfc2157f08', 'request_id': 'req-f178c462-7034-4403-b78d-1953626dfd4e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.961758 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c60021199948dfa93221dfc2157f08', 'request_id': 'req-f178c462-7034-4403-b78d-1953626dfd4e'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.971733 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] The token cache is being invalidate because project c6c60021199948dfa93221dfc2157f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:52.972019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.972634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-f178c462-7034-4403-b78d-1953626dfd4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.974109 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1446/2899] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:52 2022] DELETE /identity/v3/projects/c6c60021199948dfa93221dfc2157f08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:52.979116 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.979402 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.979676 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.998636 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:53.000313 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:53.058971 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1454/2900] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:53.068111 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.068400 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.068687 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.088430 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:53.089668 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:53.097640 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1447/2901] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:53.101920 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.111501 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255f84-825b-43cb-8666-b5f360d5fc17 None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.116105 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.116699 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.116982 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.117273 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] PATH_INFO: `/v3/domains` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.117921 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81532) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:53.118226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.119813 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.131762 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1455/2902] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:53.135853 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.145639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c461ce-2d7b-4cd4-b63e-d3b75ebaf245 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.150327 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.150913 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.151194 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.151465 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.152187 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.154365 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.180850 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1448/2903] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:53 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:53.185175 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.195486 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97752cd-38f7-49da-95f4-a5e62717abff admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.250565 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.251208 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.251485 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.251773 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] PATH_INFO: `/v3/users` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.252370 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.254331 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.262032 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:53.280703 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1456/2904] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:53 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:53.283242 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.293562 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e12a9-34be-4dd1-be5d-74934268d836 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.298828 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.299458 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.299742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.300013 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.300674 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.302326 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.312238 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1449/2905] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:53.316514 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.326229 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de6db5-1c2a-4517-83d5-422812808c5d admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.330789 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d40b5-a7d4-4a07-8808-3f6685ea5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.331375 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d40b5-a7d4-4a07-8808-3f6685ea5ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.331655 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d40b5-a7d4-4a07-8808-3f6685ea5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.331929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d40b5-a7d4-4a07-8808-3f6685ea5ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.332553 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d40b5-a7d4-4a07-8808-3f6685ea5ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.334164 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d40b5-a7d4-4a07-8808-3f6685ea5ce3 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.346178 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1457/2906] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:53.350543 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.361721 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97ae67-a3ce-4200-8080-c380ffe6aa5a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.366415 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.367071 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.367354 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.367630 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] PATH_INFO: `/v3/projects/3a3a1a9e702f4c298c1bfa9ce17993f4/users/d4e6af1705aa40518cef0212aebc58c1/roles/b191ebef2f53453e846b638562cda626` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.382798 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3a1a9e702f4c298c1bfa9ce17993f4, user_id=d4e6af1705aa40518cef0212aebc58c1, role_id=b191ebef2f53453e846b638562cda626)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.385488 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.399156 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1450/2907] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:53 2022] PUT /identity/v3/projects/3a3a1a9e702f4c298c1bfa9ce17993f4/users/d4e6af1705aa40518cef0212aebc58c1/roles/b191ebef2f53453e846b638562cda626 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:53.409356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] REQUEST_METHOD: `POST` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.409649 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.409929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.437107 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.auth.core [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] MFA Rules not processed for user `d4e6af1705aa40518cef0212aebc58c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81532) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:53.438918 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:53.503427 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1458/2908] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:10:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:53.514098 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.515890 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:53.530495 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:53.574263 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af063663-40fb-4d62-b984-b983663ef00a admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.577982 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1863-f674-45f1-9b35-210be5853f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a7f863bc194cefaec8d5fb79c670fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.578589 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1863-f674-45f1-9b35-210be5853f35 service cinder] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.578891 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1863-f674-45f1-9b35-210be5853f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.579147 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1863-f674-45f1-9b35-210be5853f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.587257 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e1863-f674-45f1-9b35-210be5853f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.588670 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e1863-f674-45f1-9b35-210be5853f35 service cinder] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.597394 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1451/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:03.499999 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:03.582226 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:03.593389 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=20 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:03.643552 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f71d0-36f4-474c-8aa6-1abc281723ee None None] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:03.648144 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:03.648767 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:03.649048 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:03.649362 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] PATH_INFO: `/v3/users/d4e6af1705aa40518cef0212aebc58c1` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:03.650475 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e6af1705aa40518cef0212aebc58c1)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:03.652380 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:03.698343 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e6af1705aa40518cef0212aebc58c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.699000 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e6af1705aa40518cef0212aebc58c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.705948 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e6af1705aa40518cef0212aebc58c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.718023 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e6af1705aa40518cef0212aebc58c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.725444 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e6af1705aa40518cef0212aebc58c1'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.731184 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1459/2910] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:03 2022] DELETE /identity/v3/users/d4e6af1705aa40518cef0212aebc58c1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:03.735659 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:03.735948 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:03.736225 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:03.754555 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] MFA Rules not processed for user `9c73d388b9994677b676c66beb55374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:03.755742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:03.813203 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1452/2911] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 08:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:03.822684 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:03.824102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:03.880187 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290bc84-004a-490f-89c3-56a2a3377884 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:03.883975 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:03.884576 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:03.884853 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:03.885124 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:03.894143 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:03.896091 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:03.905601 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1460/2912] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:04.172053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:04.174044 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.186542 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5df02-20b3-43be-a325-b3f6712e1317 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.191185 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:04.192440 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.192785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.193121 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] PATH_INFO: `/v3/projects/3a3a1a9e702f4c298c1bfa9ce17993f4` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.194339 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3a1a9e702f4c298c1bfa9ce17993f4)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:04.196576 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:04.243378 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3a1a9e702f4c298c1bfa9ce17993f4', 'request_id': 'req-661db380-5d75-4059-9126-037b6c179e47'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.249363 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3a1a9e702f4c298c1bfa9ce17993f4', 'request_id': 'req-661db380-5d75-4059-9126-037b6c179e47'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.257341 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3a1a9e702f4c298c1bfa9ce17993f4', 'request_id': 'req-661db380-5d75-4059-9126-037b6c179e47'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.267520 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] The token cache is being invalidate because project 3a3a1a9e702f4c298c1bfa9ce17993f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:04.267801 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.268454 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.270522 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1453/2913] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:04 2022] DELETE /identity/v3/projects/3a3a1a9e702f4c298c1bfa9ce17993f4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:13.901146 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:14.264445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:49.414449 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:49.415934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:49.483556 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489bfb3-e37a-4ba4-a876-84c85cb3481b service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:49.541297 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:49.541904 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:49.542188 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:49.542466 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:49.544201 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:49.555628 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:49.557185 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:49.566934 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1461/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:58.606960 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:58.608496 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:58.667211 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db380-5d75-4059-9126-037b6c179e47 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:58.670812 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:58.671444 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:58.671729 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:58.672001 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:58.673775 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:58.684373 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:58.685823 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:58.694118 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1454/2915] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:58.776579 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:58.786231 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036863-3430-44c8-8e40-803b5faed47d service placement] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:58.789877 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:58.790467 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:58.790746 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:58.791017 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:58.792727 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:58.861465 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:58.862901 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:58.874060 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1462/2916] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:08.690232 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=26 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:08.869281 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=92 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:52.690935 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:52.692417 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:52.702712 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9f00c-61f5-419b-85a4-ffc02ba96843 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:52.706274 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:52.706889 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:52.707169 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:52.707435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:52.709040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:52.718208 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:52.719619 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:52.728019 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1455/2917] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:02.724406 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=6 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:37.993686 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.995725 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.011549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbc4d-b05a-4359-a919-156ac948ec68 service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.017040 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.017663 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.017947 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.018222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.019928 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.077896 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.079480 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.088280 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1463/2918] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:39.858435 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:39.873215 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3a6ce-351e-4e4b-8a35-fd367d26ccb5 service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:39.880847 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8324e7cb70744038987b7d15f002160f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:39.881487 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:39.881770 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:39.882040 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:39.883794 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:39.898914 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:39.900445 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:39.911971 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1456/2919] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:40.051586 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:40.061132 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559aa76-221e-47d4-b7ff-0fdd1ecb7b99 service nova] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:40.065359 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:40.065993 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:40.066276 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:40.066545 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:40.068305 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:40.082564 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:40.083983 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:40.095222 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1464/2920] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:41.282170 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:41.292022 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19dbb-6766-4aec-96d1-ae6b3cb50a42 service nova] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:41.295634 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:41.296231 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:41.296508 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:41.296778 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:41.298561 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:41.312643 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:41.314078 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:41.325224 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1457/2921] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:43.819500 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.828356 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2132465-49b9-4c11-a164-79ff99bb2e6a service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.831953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e67c56fb2c8419aa5ed846d5412e0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.832549 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] REQUEST_METHOD: `GET` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.832829 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.833102 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.834907 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.896234 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.897710 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.907534 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1465/2922] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:49.912318 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:49.914119 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:49.961924 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594f88-8480-4f2e-aca1-1aff0f72bf3d service neutron] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:49.966475 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:49.967092 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:49.967369 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:49.967639 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] PATH_INFO: `/v3/users/e74469b727af4fcfa0afb850ffca2a6d` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:49.968742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74469b727af4fcfa0afb850ffca2a6d)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:49.970664 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:50.015833 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74469b727af4fcfa0afb850ffca2a6d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.023189 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74469b727af4fcfa0afb850ffca2a6d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.023813 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74469b727af4fcfa0afb850ffca2a6d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.035869 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74469b727af4fcfa0afb850ffca2a6d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.042840 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74469b727af4fcfa0afb850ffca2a6d'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.049138 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1458/2923] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:49 2022] DELETE /identity/v3/users/e74469b727af4fcfa0afb850ffca2a6d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:50.235903 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:50.275083 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5792-8884-4958-ba80-cd3bd7e2b99e service neutron] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:50.333306 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=100 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:50.341021 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:50.341848 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:50.342310 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:50.342659 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] PATH_INFO: `/v3/projects/f76e8cd706d0481e8ca9e40901752cbf` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:50.344953 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76e8cd706d0481e8ca9e40901752cbf)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:50.347084 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:50.400538 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76e8cd706d0481e8ca9e40901752cbf', 'request_id': 'req-c973da4c-1cab-44da-9304-5ef962974475'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.408529 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76e8cd706d0481e8ca9e40901752cbf', 'request_id': 'req-c973da4c-1cab-44da-9304-5ef962974475'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.416394 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76e8cd706d0481e8ca9e40901752cbf', 'request_id': 'req-c973da4c-1cab-44da-9304-5ef962974475'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.427882 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] The token cache is being invalidate because project f76e8cd706d0481e8ca9e40901752cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:50.428177 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.428867 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.430516 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1466/2924] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:50 2022] DELETE /identity/v3/projects/f76e8cd706d0481e8ca9e40901752cbf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:50.434723 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:50.436173 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:50.450927 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e508-31f0-48cd-b2ae-5af41d169dde admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:50.513420 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:50.514038 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:50.514298 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:50.514570 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] PATH_INFO: `/v3/users/42f1e8b05a9c48e4b24590f466ac3fec` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:50.515941 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f1e8b05a9c48e4b24590f466ac3fec)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:50.517952 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:50.531710 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:50.569862 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f1e8b05a9c48e4b24590f466ac3fec'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.578734 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f1e8b05a9c48e4b24590f466ac3fec'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.579478 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f1e8b05a9c48e4b24590f466ac3fec'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.591360 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f1e8b05a9c48e4b24590f466ac3fec'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.599127 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f1e8b05a9c48e4b24590f466ac3fec'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.605184 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1459/2925] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:50 2022] DELETE /identity/v3/users/42f1e8b05a9c48e4b24590f466ac3fec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:50.792929 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Authenticating user token {{(pid=81532) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:50.794419 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.fernet_utils [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81532) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:50.808997 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973da4c-1cab-44da-9304-5ef962974475 admin admin] Validating token access rules against request {{(pid=81532) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:50.872408 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c73d388b9994677b676c66beb55374b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef5d9282c24b4d00b4d4a768619e22cb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81532) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:50.873033 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:50.873347 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:50.873620 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] PATH_INFO: `/v3/projects/c0c47ec1496a4c24933dc98748666605` {{(pid=81532) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:50.874753 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c47ec1496a4c24933dc98748666605)` {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:50.876646 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] RBAC: Authorization granted {{(pid=81532) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:50.923804 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c47ec1496a4c24933dc98748666605', 'request_id': 'req-72241813-3fe6-4fce-bc8c-1b403a5e75a4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.929805 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c47ec1496a4c24933dc98748666605', 'request_id': 'req-72241813-3fe6-4fce-bc8c-1b403a5e75a4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.937651 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c47ec1496a4c24933dc98748666605', 'request_id': 'req-72241813-3fe6-4fce-bc8c-1b403a5e75a4'} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.947840 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] The token cache is being invalidate because project c0c47ec1496a4c24933dc98748666605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81532) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:50.948131 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.948745 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG keystone.notifications [None req-72241813-3fe6-4fce-bc8c-1b403a5e75a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81532) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:50.950245 dv-cinder-852210-4-smb devstack@keystone.service[81532]: [pid: 81532|app: 0|req: 1467/2926] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:50 2022] DELETE /identity/v3/projects/c0c47ec1496a4c24933dc98748666605 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:00.601696 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:00.944911 dv-cinder-852210-4-smb devstack@keystone.service[81532]: DEBUG dbcounter [-] [81532] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:56.412306 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:56.413742 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:56.524309 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e04be0-4753-4b42-963c-33c6a74dfa26 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:56.581897 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9e01118c984c2b895bad9d696d586b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d17bd537b5446aabfb9fc6d2c89186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:56.582499 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:56.582780 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:56.583053 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:56.584757 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:56.595785 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:56.597366 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9b85-2303-46bb-9129-125d098944f7 service placement] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:56.607164 dv-cinder-852210-4-smb devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1460/2927] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 08:16:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:17:06.602986 dv-cinder-852210-4-smb devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=74 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}